-- Logs begin at Tue 2022-08-23 22:30:34 UTC, end at Tue 2022-08-23 23:45:15 UTC. -- Aug 23 23:11:12.424330 dv-osbrick-853457-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 23:11:12.435818 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 23:11:12 2022] *** Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: nodename: dv-osbrick-853457-3-ceph Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: machine: x86_64 Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: clock source: unix Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: pcre jit disabled Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: detected number of CPU cores: 4 Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: current working directory: / Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: detected binary path: /usr/bin/uwsgi-core Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: your processes number limit is 47680 Aug 23 23:11:12.437868 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: your memory page size is 4096 bytes Aug 23 23:11:12.438500 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: detected max file descriptor number: 2048 Aug 23 23:11:12.438500 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: lock engine: pthread robust mutexes Aug 23 23:11:12.438500 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: thunder lock: enabled Aug 23 23:11:12.438500 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 23:11:12.438500 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 23:11:12.484305 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: Python main interpreter initialized at 0x55f3456c49c0 Aug 23 23:11:12.484305 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: python threads support enabled Aug 23 23:11:12.484305 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: your server socket listen backlog is limited to 100 connections Aug 23 23:11:12.484305 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: your mercy for graceful operations on workers is 90 seconds Aug 23 23:11:12.484669 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 23:11:12.484669 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: *** Operational MODE: preforking *** Aug 23 23:11:12.484950 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: *** uWSGI is running in multiple interpreter mode *** Aug 23 23:11:12.484950 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: spawned uWSGI master process (pid: 88537) Aug 23 23:11:12.485155 dv-osbrick-853457-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 23:11:12.487078 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: spawned uWSGI worker 1 (pid: 88549, cores: 1) Aug 23 23:11:12.487078 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: spawned uWSGI worker 2 (pid: 88550, cores: 1) Aug 23 23:11:12.487078 dv-osbrick-853457-3-ceph devstack@keystone.service[88537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 23:11:17.190836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:11:17.190836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: from cryptography.utils import int_from_bytes Aug 23 23:11:17.191679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:11:17.191679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: from cryptography.utils import int_from_bytes Aug 23 23:11:17.192016 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:11:17.192016 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: from cryptography.utils import int_from_bytes Aug 23 23:11:17.192527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:11:17.192527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: from cryptography.utils import int_from_bytes Aug 23 23:11:17.245234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:11:17.245420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:11:17.245616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] command line args: [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:11:17.245893 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:11:17.246079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ================================================================================ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:11:17.246341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] admin_token = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.246533 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:11:17.246622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] config_dir = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.246736 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:11:17.246830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.246935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] command line args: [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:11:17.247020 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] config_source = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.247120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] debug = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.247205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:11:17.247329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.247592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ================================================================================ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:11:17.247663 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] admin_token = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.247727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.247914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_dir = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_source = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248430 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] debug = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248684 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.248921 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_config_append = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249235 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_dir = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249627 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.249923 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_config_append = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250395 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_dir = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250679 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.250874 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251127 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251320 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251781 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251860 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.251937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252159 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252910 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.252990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] publish_errors = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253896 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.253978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254483 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] publish_errors = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.254946 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] standard_threads = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255810 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.255936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256066 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] use_journal = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] use_json = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] standard_threads = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256413 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] use_stderr = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256538 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.256620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] use_syslog = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257061 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.257505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_journal = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.257648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_json = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257767 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_stderr = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.257852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.257950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_syslog = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.258072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258186 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:11:17.258292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258776 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.258957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259579 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259831 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.259997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260077 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260517 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260775 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.260864 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261025 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261346 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261518 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261761 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.261840 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262346 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262506 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262584 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.262850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263271 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.263988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264067 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264317 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264517 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.264845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265092 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.265978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266297 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266542 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266770 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.266937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267176 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267651 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.267977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268133 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268213 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268638 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268881 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.268969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269202 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269440 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.269925 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270082 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270571 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.270815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.271419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.271609 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.271738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.271836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.271919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.272934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273014 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273177 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.273994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274651 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.274971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275373 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275609 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275840 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.275970 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276487 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.276984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.277944 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278102 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278344 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.278908 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279389 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.279875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.280868 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281263 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281342 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281820 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.281968 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282203 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282285 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.282997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.external = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283558 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.283976 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.password = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284580 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.token = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.external = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.284976 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.password = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.285951 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.token = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.286039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.286195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.286276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.286434 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.286557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287268 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.287988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288251 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288567 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288727 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.288983 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289082 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289593 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.289848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290100 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.290868 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291029 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291289 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291378 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291620 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.291855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292122 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292556 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.292814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.296941 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297367 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297663 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297809 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297883 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.297956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298108 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298417 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298794 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298915 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.298986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299129 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299514 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.299958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300100 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300251 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300403 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300523 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300609 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300678 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300757 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300912 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.300987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301204 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301356 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301634 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.301934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302006 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302635 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302914 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.302975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.303913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304080 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304337 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304602 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304850 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.304931 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305087 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305608 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305689 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305863 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.305944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306106 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.306922 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307162 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.307907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308071 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308151 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308652 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308733 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.308893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309420 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.309962 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310298 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310590 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.310971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311457 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311700 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.311938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.312945 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313027 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313318 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313514 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313765 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.313999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314385 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314464 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314626 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314869 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.314949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315444 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315847 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.315929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.316996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317638 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.317922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318071 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318642 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.318876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] role.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] role.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319299 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319380 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319642 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.319919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320171 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320605 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.320928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321100 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321181 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321696 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.321995 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322617 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322791 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.322978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323060 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323747 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.323836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324083 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324624 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324802 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.324883 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.325064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.326717 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.326831 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.326913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.326987 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327060 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327373 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327450 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327900 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.327979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328042 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328612 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328905 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.328986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329206 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.329918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330658 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.330922 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331408 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.331908 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332324 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.332928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.333099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.333180 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.333878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334656 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.334909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335153 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335341 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335636 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.335892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336090 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336181 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.336953 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.337102 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.337184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.337280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:11:17.337363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.337573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.337818 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.338069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.338369 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.338632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.338884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.339127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.339383 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.339648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.339901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.340139 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.340386 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.340655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:11:17.340833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:11:17.367248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.367482 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.367723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.374482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.374724 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.374958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.376292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.383925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.406746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.406980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.410837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.411072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.460590 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.461738 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.511185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.511421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.512612 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.512860 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.581818 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.581995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582094 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582507 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582859 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.582943 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.583088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.606758 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.606990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607885 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.607970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.608101 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.608195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.608327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.608587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.624845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.627110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.638523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.638763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639275 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639874 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.639958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.640099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.640318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.640560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.640779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:11:17.667686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.667899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:11:17.668202 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.668287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.668414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:11:17.668520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:11:17.668739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.668822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.668974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:11:17.669057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.669251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.669335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.669516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.669607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.669778 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.670037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.679796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680523 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.680801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.681063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.687614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.687906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.690558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.690859 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.690987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.691152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.691239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.691451 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.691597 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.691764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.691893 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.692975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.693977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.716800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.718198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.718340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.718481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.719686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.719984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.723004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.723293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.723581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.725130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.725418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.725712 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.732315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.732509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.732643 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.732771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.736613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.736752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.736909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737317 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737610 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.737906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738620 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.738777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.754855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.755033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.755193 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.755993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.759951 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.760260 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.763102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.763277 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.765947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.766103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.767868 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.767963 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.771602 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.771779 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.774866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.774971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775163 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.775882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.776034 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.776119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.776334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.776472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.792297 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.792562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.792696 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.792861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.792947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.793149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.793233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.793422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.799890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.800161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.801564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.801845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.801983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.802284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.804826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.804961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.805132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.805987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.806203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.817399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.817518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.818225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.818438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.818583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.818704 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.818934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819082 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819257 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819354 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819550 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.819914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.835997 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.837184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.838981 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.839082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.842038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.842180 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.843478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.843946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.845022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.845318 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.845459 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.845610 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.845747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.846046 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.852848 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.852954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.854347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.854549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.857250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.857552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.857637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.857846 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.857931 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.858131 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.858215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.858416 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.866429 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.866792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.867088 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.867336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.867638 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.867929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.874003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.874304 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.874590 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.874863 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:11:17.874947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875139 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875555 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.875999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.876140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.876425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.876749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877613 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.877982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878757 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.878851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:11:17.913478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3456c49c0 pid: 88550 (default app) Aug 23 23:11:17.913633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3456c49c0 pid: 88549 (default app) Aug 23 23:11:17.917041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676869-84f7-4792-bee9-63e72c75cccf None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.917341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676869-84f7-4792-bee9-63e72c75cccf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.917625 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676869-84f7-4792-bee9-63e72c75cccf None None] PATH_INFO: `/v3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.921838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 791 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:26.559088 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.559629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.559629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.563985 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 1/2] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:11:26.569415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.569851 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.569980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.654077 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: INFO dbcounter [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] Registered counter for database keystone Aug 23 23:11:26.675641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG oslo_db.sqlalchemy.engines [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:11:26.682481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writer thread running {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:11:26.862055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG passlib.handlers.bcrypt [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88549) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:11:26.862414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG passlib.handlers.bcrypt [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88549) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:11:26.918113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:26.919736 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:27.057458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 2/3] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 23:11:27.557121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.634804 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: INFO dbcounter [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] Registered counter for database keystone Aug 23 23:11:27.654197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG oslo_db.sqlalchemy.engines [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:11:27.660537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writer thread running {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:11:27.778561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585cdd-0b6a-453c-8a1e-0479d3b4f80e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.782829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.783446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.783725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.783999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.792946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.844041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:11:27.844326 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d6043-a268-41ba-ac66-8865b3d086d1 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.855001 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 2/4] 10.222.0.91 () {58 vars in 1324 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 23:11:27.861311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.878189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0cd8-1dcb-464a-8aaf-2c757072f81e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.883018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.884093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.884381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.884694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] PATH_INFO: `/v3/projects/85959ef3f874453fbd26b056e71b4f53` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.886191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] RBAC: Authorizing `identity:get_project(project_id=85959ef3f874453fbd26b056e71b4f53)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.936683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:11:27.937023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1131dd-d07a-470d-8f8c-bbf449c8f65f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.941647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 3/5] 10.222.0.91 () {56 vars in 1207 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/projects/85959ef3f874453fbd26b056e71b4f53 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:30.112983 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5ac3-f2db-4346-bd8e-888005e66114 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.113527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5ac3-f2db-4346-bd8e-888005e66114 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.113527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5ac3-f2db-4346-bd8e-888005e66114 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.117713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 3/6] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:30.123171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.123553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.123740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.144016 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:30.146179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:30.155065 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 4/7] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 23:11:30.487891 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf5ac3-f2db-4346-bd8e-888005e66114 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.500807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf5ac3-f2db-4346-bd8e-888005e66114 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.505606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.506248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.506834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.507088 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.515529 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.517420 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07379-7d64-41ed-b40b-11c5b60c7f2a admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.527228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 4/8] 10.222.0.91 () {58 vars in 1324 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 23:11:30.533188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.542668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f3e21-832f-4b4f-974f-93e3509ce7a2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.547076 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.547705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.547991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.548269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.549622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.551458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbdff6-3a37-4724-ad49-8a68caeca749 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.553150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 5/9] 10.222.0.91 () {56 vars in 1198 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:32.859906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b720-d284-48d1-be8f-a0396af69e30 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.860473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b720-d284-48d1-be8f-a0396af69e30 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.860473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b720-d284-48d1-be8f-a0396af69e30 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.861815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 5/10] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:11:32.867851 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.868253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.868553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.887205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:32.888429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:32.930005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561817b7-a10c-4144-ae9c-4e3627398a44 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.930294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561817b7-a10c-4144-ae9c-4e3627398a44 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.930581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561817b7-a10c-4144-ae9c-4e3627398a44 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.931893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 6/11] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:32.937110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.937406 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.937692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.982975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG passlib.handlers.bcrypt [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88550) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:11:32.983408 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG passlib.handlers.bcrypt [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88550) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:11:33.030170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:33.031832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:33.081530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 6/12] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:33.135430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 7/13] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:33.408913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.433557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.475219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.514486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b570f-25ed-4832-9c65-6f9ab3971682 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.547940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.548604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.548886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.549161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.561843 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:33.570716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:33.571756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 7/14] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:33.579496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.581793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9c9c-62b0-46d3-a2e9-bba54d0897d4 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.585122 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.622076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.622938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.623225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.623501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.663823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.681875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2888f44-35d5-492e-96ce-f146d82cf069 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.693563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.695341 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.718050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.718890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.719294 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.719695 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.720497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.720803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.722196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.736377 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 8/15] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:33.742127 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.796765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 8/16] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:33.802331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.805117 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.848238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6dbc7-e41e-4d84-a139-eb9f9ca78a05 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.884447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.885099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.885390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.885678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.886841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.888354 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.889999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 9/17] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:33.896029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.900223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760edd-6676-4c88-932c-cae4a757349c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.910288 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.934640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.935456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.935742 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.936020 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.954144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.955610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:33.975823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:33.976954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:33.977961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:33.977961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:33.977961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:33.977961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 9/18] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:33.982704 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.997192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc734-c4a6-4707-8734-798a056e40d2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.043989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.044750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.045034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.045311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.046504 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.047996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.049705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 10/19] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:34.056007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.140390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.151127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.158912 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf7304-80ff-4c7c-adef-0526a265c3ce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.193486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.194035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.194322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.194599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.195145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129930d-badd-41e7-9165-ce7b54814b3c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.195326 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.domain.id=default, user.id=c1ea3af316ee47e789d80e3a6d797918) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:34.195637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.197157 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5f80c-32a0-414e-a20c-716132374d9a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.204332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 11/20] 10.222.0.91 () {56 vars in 1322 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/role_assignments?user.id=c1ea3af316ee47e789d80e3a6d797918&scope.domain.id=default&role.id=27562aa899b24a498ff1887ceca94449 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:34.233730 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.234368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.234652 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.234929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.235600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:34.235908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.237381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469f9ec-aa28-4b02-8dae-3c922bcd1c54 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.257691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 10/21] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:36.723674 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c795-82eb-45a9-b4d4-3c1e9e4fa469 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.724463 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c795-82eb-45a9-b4d4-3c1e9e4fa469 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.724463 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c795-82eb-45a9-b4d4-3c1e9e4fa469 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.725804 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 12/22] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:36.731322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.731777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.731950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.767131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:36.768342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:36.782312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2849-c1b0-416f-8a54-80f3a5a95a80 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.782607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2849-c1b0-416f-8a54-80f3a5a95a80 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.782878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2849-c1b0-416f-8a54-80f3a5a95a80 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.784205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 13/23] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:36.789384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13662c3-f673-4b74-9370-516073f7f201 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.789678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13662c3-f673-4b74-9370-516073f7f201 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.789964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13662c3-f673-4b74-9370-516073f7f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.808875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a13662c3-f673-4b74-9370-516073f7f201 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:36.810174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a13662c3-f673-4b74-9370-516073f7f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:36.888790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 11/24] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:36.942256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 14/25] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:37.416208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:37.477605 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:37.543353 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b858-c5cf-4906-814e-5294dc92c8e3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.543971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b858-c5cf-4906-814e-5294dc92c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.544476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b858-c5cf-4906-814e-5294dc92c8e3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.546015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 15/26] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:11:37.551165 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030a53-29c7-492a-ae49-cecbad61bd08 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.552646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030a53-29c7-492a-ae49-cecbad61bd08 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.553122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030a53-29c7-492a-ae49-cecbad61bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.563790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab2c3-cfc8-44e3-a087-cfea44a4f62e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:37.585637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-27030a53-29c7-492a-ae49-cecbad61bd08 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:37.586859 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-27030a53-29c7-492a-ae49-cecbad61bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:37.612610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:37.613556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.614563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.615102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.627203 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:37.629010 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:37.647327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:37.648212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:37.649119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:37.649119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:37.649119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:37.651155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 12/27] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:37.652352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 16/28] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f088f-a8a7-47f3-98dd-9a513581f3b7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f088f-a8a7-47f3-98dd-9a513581f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f088f-a8a7-47f3-98dd-9a513581f3b7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 17/29] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:37.663540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f088f-a8a7-47f3-98dd-9a513581f3b7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:37.665790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:37.769002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f088f-a8a7-47f3-98dd-9a513581f3b7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:37.805940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:37.806563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.806847 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.807319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.808120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:37.808609 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:37.810134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa712988-4b6f-4863-b906-163d6e01c529 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:37.829024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 18/30] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:37.830466 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.830919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.831344 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.848261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:37.851941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:37.853241 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:37.857102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634515f8-858f-47f1-91ff-868174e7931b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:37.917203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:37.925988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 19/31] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:37.927816 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:37.938128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:37.938786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:37.939077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:37.939356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:37.969372 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:37.976105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:37.976996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:37.977737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:37.985769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 13/32] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:37.993205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:38.048049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7945063-8b69-4680-9f6a-ed72bfff9db0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.120030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.120675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.120958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.121231 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.121922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.123407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.171238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386146d-56f4-4abe-b6d1-af8e5a0fdd0a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.206537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.207156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.207445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.208360 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.209076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:38.209387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.210858 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.229387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 14/33] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:38.234354 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:38.256086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:38.346807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea7fb-7255-4a44-8ea3-f687141437ed None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.404823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.405443 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.405722 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.406004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.406673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.408070 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef774-42fc-432f-9e77-f0640d70b23c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.459866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 20/34] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:11:37 2022] POST /identity/v3/projects => generated 301 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:38.464601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:38.525845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:38.626952 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155eed8-f90b-400e-aa5d-b1d5aaa2b654 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.683777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.684431 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.684749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.685029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.686273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.687917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.689548 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 21/35] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:38 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:38.690299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:38.711287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 15/36] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/roles => generated 219 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:38.718491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6617-7a15-4c30-9a15-994cdfce6b85 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.718886 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6617-7a15-4c30-9a15-994cdfce6b85 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.719174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b6617-7a15-4c30-9a15-994cdfce6b85 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.720935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 16/37] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:38.721999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b6617-7a15-4c30-9a15-994cdfce6b85 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:38.819683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7ebd-470d-45b8-ac91-00164fc2e535 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.833801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:38.837880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:38.855836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b6617-7a15-4c30-9a15-994cdfce6b85 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:38.866286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.867409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.867623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.867903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.868996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.870769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba35f81-b2cd-43a4-808a-aa2478602239 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.894823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:38.896582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.896878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.897158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.898671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:38.900258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47df2-070f-4090-bf60-f75a1a482bf9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:38.901861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 17/38] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:38.902980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e99e-935f-44ab-b32d-8fa435281a5b None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.903261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e99e-935f-44ab-b32d-8fa435281a5b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.903547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e99e-935f-44ab-b32d-8fa435281a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.921801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-6cf2e99e-935f-44ab-b32d-8fa435281a5b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:38.923339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-6cf2e99e-935f-44ab-b32d-8fa435281a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:38.952506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 22/39] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:38.958219 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752298d-9576-4bee-a61e-286f5cccd3ce None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.958566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752298d-9576-4bee-a61e-286f5cccd3ce None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.958782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752298d-9576-4bee-a61e-286f5cccd3ce None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.960505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 23/40] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:38.961180 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752298d-9576-4bee-a61e-286f5cccd3ce None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.006289 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 18/41] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:39.008068 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.008198 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.008747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.043867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:39.045507 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:39.102225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752298d-9576-4bee-a61e-286f5cccd3ce None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.143770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.144544 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 19/42] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:39.144814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.145807 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.146159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] PATH_INFO: `/v3/domains/default/users/c1ea3af316ee47e789d80e3a6d797918/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.149274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c1ea3af316ee47e789d80e3a6d797918, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.150786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.288419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 24/43] 10.222.0.91 () {58 vars in 1361 bytes} [Tue Aug 23 23:11:38 2022] PUT /identity/v3/domains/default/users/c1ea3af316ee47e789d80e3a6d797918/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:39.341752 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.353644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.464279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef92b-5e46-4d99-a9d0-7ce665e74b02 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.481744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.503864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.504606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.505015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.505199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.505891 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.507617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65492c-7f9a-4681-bc08-52cc957be2e1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.523235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.589755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974178-d8ef-49d1-9838-9465f189faef None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.623634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.624276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.624600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.624885 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.626006 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.627477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.629081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 25/44] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:39.634744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.691300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 20/45] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/roles => generated 223 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:39.741748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b1b9-3d3b-42cd-aa16-dd0ac43bd8f0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.766857 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.782775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.783410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.783700 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.783978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.784675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.786767 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42d97-236e-4aeb-a71d-cd47f04aa50d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.875794 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 26/46] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:41.512042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a114bb-e061-4ca5-905c-cd748f94b7a2 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:41.512558 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a114bb-e061-4ca5-905c-cd748f94b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:41.512558 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a114bb-e061-4ca5-905c-cd748f94b7a2 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:41.513870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 21/47] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:41.519072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6783f-4088-4f64-96e5-0b99f84ad365 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:41.519496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6783f-4088-4f64-96e5-0b99f84ad365 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:41.519636 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6783f-4088-4f64-96e5-0b99f84ad365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:41.538723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a7b6783f-4088-4f64-96e5-0b99f84ad365 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:41.540251 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a7b6783f-4088-4f64-96e5-0b99f84ad365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:41.609284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 27/48] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:41.936766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a114bb-e061-4ca5-905c-cd748f94b7a2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.007872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.042714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a114bb-e061-4ca5-905c-cd748f94b7a2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.076349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.077011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.077300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.077579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.088107 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:42.092816 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9f6b-a800-43bc-aeba-15e7392f113c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.093118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9f6b-a800-43bc-aeba-15e7392f113c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:42.093227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:42.094173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:42.094980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:42.095544 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9f6b-a800-43bc-aeba-15e7392f113c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.095544 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 28/49] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:11:42.096574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 22/50] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:42.100524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.100823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.101114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.101392 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.120964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:42.122328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:42.197461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 29/51] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:42.207987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab2cc-b32a-44ca-82d8-e680fd7106b8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.237949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.245995 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.246612 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.246903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.247182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.247848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:42.248154 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.249571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.258381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 23/52] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:42.264027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.280005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.362574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6ce98-7adc-498a-8f63-4db487e632bf None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.396492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.397130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.397413 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.397785 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.399262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.401807 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.403381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 30/53] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:42 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:42.409022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.512143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e3bb-6664-4e8c-80b2-d68624df1495 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.541668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.545834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.546467 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.546754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.547033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.548165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.549664 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.551411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 24/54] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:42.557267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.617073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.625366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.643855 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f675-1605-4969-be6c-08776e03c926 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.658726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc573-a731-4d5d-804c-57a25edced84 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.678073 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.678678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.678967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.679250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.680394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.681974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.683626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 31/55] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:42.689852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:42.697857 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.698713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.700042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.700042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.700209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.domain.id=default, user.id=c1ea3af316ee47e789d80e3a6d797918) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:42.700402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.701895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdfc2-9af3-40e2-838f-683feed2027b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.711103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 25/56] 10.222.0.91 () {56 vars in 1322 bytes} [Tue Aug 23 23:11:42 2022] GET /identity/v3/role_assignments?user.id=c1ea3af316ee47e789d80e3a6d797918&scope.domain.id=default&role.id=27562aa899b24a498ff1887ceca94449 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:42.797579 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aa784-43ea-41e3-83f5-d2428197e239 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:42.834581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:42.835217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.835505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.835784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.836484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:42.838037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be632735-b37b-48ba-a8f1-a2e2e2ccf822 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:42.937695 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 32/57] 10.222.0.91 () {60 vars in 1140 bytes} [Tue Aug 23 23:11:42 2022] POST /identity/v3/projects => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:45.148949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367de-6a91-407b-9fd8-c81c64d45e4c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.149510 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367de-6a91-407b-9fd8-c81c64d45e4c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.149510 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367de-6a91-407b-9fd8-c81c64d45e4c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.150886 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 26/58] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:45.156162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.156618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.156759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.163329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.175248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:45.177155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:45.244792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 33/59] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:45.577265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4367de-6a91-407b-9fd8-c81c64d45e4c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.680415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4367de-6a91-407b-9fd8-c81c64d45e4c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.703059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.714666 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.715294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.715581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.715861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.717009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.718586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa561-5423-4c35-aeac-1066693994ef None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.720175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 27/60] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.726736 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.822546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8c21c-329c-4917-a03d-cfa381d906f0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.851867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.856624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.857237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.857525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.857805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.858447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.859960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7387fa-1457-4293-bb71-33fa16a26710 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.952730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 34/61] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:11:45 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:49.492050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be6f9-e2c5-4032-a451-ab0cbdd2bba0 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.493084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be6f9-e2c5-4032-a451-ab0cbdd2bba0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.493596 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be6f9-e2c5-4032-a451-ab0cbdd2bba0 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.495168 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 28/62] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:49.505723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c20-40c2-4a41-b082-b925a3f458f8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.506283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c20-40c2-4a41-b082-b925a3f458f8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.506744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c20-40c2-4a41-b082-b925a3f458f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.530139 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b253ec-b4c3-4bff-8633-045cd47dccc1 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.530749 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b253ec-b4c3-4bff-8633-045cd47dccc1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.531227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b253ec-b4c3-4bff-8633-045cd47dccc1 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.532374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0a6c0c20-40c2-4a41-b082-b925a3f458f8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:49.533280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 29/63] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:49.535119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0a6c0c20-40c2-4a41-b082-b925a3f458f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:49.543301 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366201-39d0-4bec-8f4f-f6604a3596c6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.543886 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366201-39d0-4bec-8f4f-f6604a3596c6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.544363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366201-39d0-4bec-8f4f-f6604a3596c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.584625 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b8366201-39d0-4bec-8f4f-f6604a3596c6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:49.585878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b8366201-39d0-4bec-8f4f-f6604a3596c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:49.638027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 35/64] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:49.644175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa8c8-fc7e-4676-ae9f-4b11efe606af None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.644489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa8c8-fc7e-4676-ae9f-4b11efe606af None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.644879 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa8c8-fc7e-4676-ae9f-4b11efe606af None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.646406 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 36/65] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:49.652068 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fd7f-5521-430f-854c-a88da085a6c8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.652367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fd7f-5521-430f-854c-a88da085a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.652674 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fd7f-5521-430f-854c-a88da085a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.662660 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 30/66] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:49.685327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-86d6fd7f-5521-430f-854c-a88da085a6c8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:49.686616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-86d6fd7f-5521-430f-854c-a88da085a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:49.782385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 37/67] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:49.847406 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c8ad-dc6c-4d3d-9831-0ea64cf74cb8 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.847715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c8ad-dc6c-4d3d-9831-0ea64cf74cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.847969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c8ad-dc6c-4d3d-9831-0ea64cf74cb8 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.850243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 31/68] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:49.855585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c502749-4b39-4340-af5d-625afeefe47a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.855881 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c502749-4b39-4340-af5d-625afeefe47a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.856166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c502749-4b39-4340-af5d-625afeefe47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.885480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4c502749-4b39-4340-af5d-625afeefe47a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:49.886720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4c502749-4b39-4340-af5d-625afeefe47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:49.939601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:49.965198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 38/69] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:50.033243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c8ad-dc6c-4d3d-9831-0ea64cf74cb8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.160408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc450e-9912-47cd-87d5-9d24210625a2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.161628 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc450e-9912-47cd-87d5-9d24210625a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.162255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc450e-9912-47cd-87d5-9d24210625a2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.163837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 39/70] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:11:50.169150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.169665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.170174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.190607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c8ad-dc6c-4d3d-9831-0ea64cf74cb8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.192484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:50.195040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:50.212875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.228550 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.230862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.230862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.230862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.242934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:50.248264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:50.249343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:50.250287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:50.251165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 32/71] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:50.252672 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.292688 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 40/72] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:50.293516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.368830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356610-d753-4285-bffe-bd5fa532e158 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.402895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55030f9-c2f1-4f24-88da-2211896327d3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.406215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.406854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.407144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.407425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.413693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.419790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:50.425728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:50.433338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 33/73] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:50.434072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.446899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.447517 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.447808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.448090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.448811 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:50.449150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.450758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.464506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 41/74] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.464506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.478238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.539929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73c68e-30d1-44cd-8a91-47de2664a6b5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.577276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45d4a-b2e4-454f-9b2e-ece54eaa8726 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.577765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.578085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.578397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.578913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.592977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:50.597989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:50.604405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 34/75] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:50.605214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.619506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.620148 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.620428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.620728 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.632953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:50.638008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:50.638947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:50.639713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 42/76] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:50.640333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.675850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.714415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.717295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24db5-1286-4c8e-820b-85e8e2a99844 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.745957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb309b9-8235-4105-a565-72e282382e8c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.750394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.751001 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.751292 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.751577 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.752251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:50.752594 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.753981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.763282 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 35/77] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.764085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.781112 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.781745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.782026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.782300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.795703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.797218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.798841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 43/78] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.799600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.868489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f1c8-07d4-4cb4-aecd-1856399c7b97 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.888057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.900650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125d9d-a007-4718-bf8a-71caea98b468 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.903401 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.904013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.904300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.904613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.905310 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:50.905623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.907016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.915261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 36/79] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.915889 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.935479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.936120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.936409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.936719 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.937845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.939306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.940929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 44/80] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.941690 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.947142 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.024546 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240b81-7654-4271-b30c-89d6e75df79f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.044055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbecdc3-b3fa-4646-9fae-9916db4858e5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.058552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.059161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.059447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.059728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.060393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:51.060732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.062104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.070912 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 37/81] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.071472 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.082361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.083536 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.083816 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.084097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.085262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.086749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.088348 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 45/82] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.089156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.114629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.157787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.172878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01819ff-4be1-4c52-8674-243e6bae8cb5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.189287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607371-0329-4244-a9e6-f5450ec048a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.206374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.206986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.207268 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.207546 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.229186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.229836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.230118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.230823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.232017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.233511 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.235077 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 46/83] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.235818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.279288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.280798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.326918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.335989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846f1d-0658-4826-8845-226ce4546143 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.365251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.369812 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.370427 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.370713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.370996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.371637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.373133 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.381305 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 38/84] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:51.386460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.473305 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 47/85] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:11:51 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:51.474384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.486247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9ad7-8281-4848-b2e5-65224d4b009d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.528327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.529027 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.529320 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.529599 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.531114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.532662 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.534384 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 39/86] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.535218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.600205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a00a1-e782-46be-81a3-acdaeb088528 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.607247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.639728 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.640368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.640701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.641134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.661895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.663131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0cedd-0877-4ec9-9ddc-1883f67cf20a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.705903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.706542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.706893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.707178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.724945 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.726363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.796204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.797853 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.857696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 48/87] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:51.858353 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.868425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.925137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.926266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 40/88] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:51.932676 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.003099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585012b8-8fda-428c-803f-34ea5952fe2c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.051098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f4b8-6d3b-4842-b540-fbb990fb2b00 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.098142 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925352-2157-40b2-a567-11370864777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.099409 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925352-2157-40b2-a567-11370864777e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.099846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925352-2157-40b2-a567-11370864777e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.100138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925352-2157-40b2-a567-11370864777e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.101397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.102267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.103065 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.103575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.105981 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.107686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.110469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 49/89] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.111968 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.128777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.187058 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58925352-2157-40b2-a567-11370864777e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.189097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58925352-2157-40b2-a567-11370864777e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.243412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1d47-204c-4c90-8d6f-bb974e33a9f1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.260879 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.279101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.279665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.281283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.281283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.281500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.283154 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.284830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 50/90] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.285594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.304806 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 41/91] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:52.305959 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925352-2157-40b2-a567-11370864777e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.365111 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.402060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e0df-dcce-4df3-9601-b7fff5a7bdab None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.414145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925352-2157-40b2-a567-11370864777e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.439208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.440003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.440186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.440494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.441678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.443809 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.445549 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 51/92] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.446266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.453644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.454516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.454982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.455435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.456340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.456823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.459149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.465096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 42/93] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=686d6006762640dba07b0fb12570a686 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.466028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.505730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.559989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f8cd-2bbf-4e9b-bcac-469efae34093 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.585169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4ff9-bd31-47b7-b1d1-1967fc3c3019 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.597882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.598280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.598598 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.598953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.599943 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=c1ea3af316ee47e789d80e3a6d797918) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.600258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.601765 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.606832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.607683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 52/94] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/role_assignments?user.id=c1ea3af316ee47e789d80e3a6d797918&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=27562aa899b24a498ff1887ceca94449 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.612689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.641503 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.642797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.643251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.643685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] PATH_INFO: `/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.648115 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] RBAC: Authorizing `identity:get_project(project_id=b97d91ee36aa4447ae042e54b0a5d1f9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.649972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.652494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 43/95] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.663357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.832837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba209b52-3c20-4c43-81eb-997e1c324808 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.840481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ffd60-b5d6-49a6-8938-dd5d263f8fcd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.865250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.883029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.883705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.884007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.884284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.885104 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] RBAC: Adding query filter params (role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.885424 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.887071 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22fed-8860-45d8-84eb-8b0067a08009 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.893188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 53/96] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.909391 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.910302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.910746 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.911700 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.912663 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b97d91ee36aa4447ae042e54b0a5d1f9, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.913165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.914819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9216c-fda2-426a-a46b-8fa60a607da6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.921774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 44/97] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=b97d91ee36aa4447ae042e54b0a5d1f9&role.id=686d6006762640dba07b0fb12570a686 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:54.248009 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd1b6-2b19-4f7d-859a-6b63ec570b66 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.248937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd1b6-2b19-4f7d-859a-6b63ec570b66 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.249440 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd1b6-2b19-4f7d-859a-6b63ec570b66 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.251286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 54/98] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:54.257645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f597-1642-4223-a22e-06cb9d524e3f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.258483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f597-1642-4223-a22e-06cb9d524e3f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.258980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f597-1642-4223-a22e-06cb9d524e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.278483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-5cc9f597-1642-4223-a22e-06cb9d524e3f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:54.280123 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5cc9f597-1642-4223-a22e-06cb9d524e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:54.345682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.367482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 45/99] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:54.375810 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684275-d9bc-49dc-9a36-9a659a68cd21 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.376383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684275-d9bc-49dc-9a36-9a659a68cd21 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.376909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684275-d9bc-49dc-9a36-9a659a68cd21 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.378947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 55/100] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:54.385099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.385659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.386163 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.405950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:54.407477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:54.494662 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 46/101] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:55.001727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684275-d9bc-49dc-9a36-9a659a68cd21 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.056141 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.211966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa64c21-3829-4f5f-b045-02aac126dcbc None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.215432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684275-d9bc-49dc-9a36-9a659a68cd21 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.239998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.285407 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.286018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.287045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.287045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.293136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.294099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.294582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.294755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.295049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.295328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.296525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 47/102] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:55.302940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.315035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:55.320405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:55.321304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:55.322120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:55.329580 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 56/103] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:55.335308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.400835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.521662 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0580-9fdc-4825-b8c4-94f719484e10 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.533768 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a49ce5-7e49-40e2-8894-aa9b38ff8008 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.600009 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.600410 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.601069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.601357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.601638 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.601855 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.602335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.602444 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.602921 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.603799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:55.603905 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.604390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.610416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.625758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 57/104] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:55.631698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.761110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 48/105] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:11:55 2022] POST /identity/v3/projects => generated 302 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:55.828235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0050-c006-4e27-88f7-c6561be3c8a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.832953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.882394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.883215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.883504 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.883784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] PATH_INFO: `/v3/users/05a2b850b9064503849b1f14785e0cd8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.907248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] RBAC: Authorizing `identity:get_user(user_id=05a2b850b9064503849b1f14785e0cd8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.908784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4147c75-8a32-452b-8325-e4b2402a892a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.910841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 58/106] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/users/05a2b850b9064503849b1f14785e0cd8 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:55.916281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.969005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.059722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755726c-2d97-48a2-8b00-6ead9a40083e None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.060048 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755726c-2d97-48a2-8b00-6ead9a40083e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.060282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755726c-2d97-48a2-8b00-6ead9a40083e None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.061867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 59/107] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:56.067927 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbbdd8-5156-422c-9e46-a3b36876860d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.068192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df4b6-0a5b-4bdf-a057-7c35ef7313d3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.068523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df4b6-0a5b-4bdf-a057-7c35ef7313d3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.068824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df4b6-0a5b-4bdf-a057-7c35ef7313d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.105633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2e1df4b6-0a5b-4bdf-a057-7c35ef7313d3 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:56.106914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2e1df4b6-0a5b-4bdf-a057-7c35ef7313d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:56.127346 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.127979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.128264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.128677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.234870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 60/108] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:56.241508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c98da-6d28-4934-8717-cdc3fc9ef419 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.242107 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c98da-6d28-4934-8717-cdc3fc9ef419 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.243004 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c98da-6d28-4934-8717-cdc3fc9ef419 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.245089 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 61/109] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:56.251569 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebdf3-fb8c-4803-9eca-a48b28b9dc9a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.252121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebdf3-fb8c-4803-9eca-a48b28b9dc9a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.252814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebdf3-fb8c-4803-9eca-a48b28b9dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.276225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-53bebdf3-fb8c-4803-9eca-a48b28b9dc9a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:56.278104 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-53bebdf3-fb8c-4803-9eca-a48b28b9dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:56.313534 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.315031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f5d4-39ba-4a78-bb8b-218b7e6f1524 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.368867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.376995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 62/110] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:56.386024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b7172-dd66-411f-880f-17be3d863bd8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.386024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b7172-dd66-411f-880f-17be3d863bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.386024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b7172-dd66-411f-880f-17be3d863bd8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.386024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 63/111] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:56.389201 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de265ec-25af-4a7d-93e3-ccb0f4bbac80 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.389718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de265ec-25af-4a7d-93e3-ccb0f4bbac80 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.390184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de265ec-25af-4a7d-93e3-ccb0f4bbac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.414735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0de265ec-25af-4a7d-93e3-ccb0f4bbac80 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:56.416279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0de265ec-25af-4a7d-93e3-ccb0f4bbac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:56.440920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.487947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 49/112] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:56.493145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7da-0752-46f7-9adb-dcd5e1880f46 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.493583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7da-0752-46f7-9adb-dcd5e1880f46 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.493987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c7da-0752-46f7-9adb-dcd5e1880f46 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.495639 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 50/113] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:56.496307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c7da-0752-46f7-9adb-dcd5e1880f46 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.534037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 64/114] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:56.537153 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.537445 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.537723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.575186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:56.577642 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:56.689257 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c7da-0752-46f7-9adb-dcd5e1880f46 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.702898 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 65/115] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:56.708880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.741269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.752757 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.758351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.758351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.758351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.758351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.758351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.759205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 51/116] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:56.765715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.886364 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.906796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e30-3752-4a61-858b-94fdccf8c232 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.931307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf2e6f-3f38-48a1-98e6-3b2e3df4886c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.949671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.950750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.951256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.951733 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.968877 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:56.974325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:56.975228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:56.975999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:56.978374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 66/117] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:56.979329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.979757 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.979945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.980236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.980604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.985784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=05a2b850b9064503849b1f14785e0cd8) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:56.985784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.985784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.995569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 52/118] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/role_assignments?user.id=05a2b850b9064503849b1f14785e0cd8&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:56.997225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.112818 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.166670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42950c0f-340e-4ad5-9630-4811213005c5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.171410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566730f5-d77e-4121-b856-73b4b372c763 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.211173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.211960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.212253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.212705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.223308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.224643 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.224987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.227871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.227871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.227871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.228430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.239225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.241273 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 53/119] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.242193 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.244723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:57.251274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:57.252158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:57.252954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:57.256637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 67/120] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:57.262583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.378399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70222f-66d4-4cae-9c79-800933b5796c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.383697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0135719-4eea-4305-96d1-17dd22e8570f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.408031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.419713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.420360 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.420675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.420958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.421735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.422681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.423164 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.423649 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.432688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:57.435414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:57.437382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:57.438251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:11:57.439008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 54/121] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:57.439643 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:57.445198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:57.446080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:57.446841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:11:57.453132 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 68/122] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:57.454307 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.534998 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.558611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8178b4-e390-4e05-8d05-3504405f0570 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.588079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4dd5-e745-4f6b-b997-01152ae6af90 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.607293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.608501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.609330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.609774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.611117 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.613395 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.616432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 55/123] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.617404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.643766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.644391 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.644698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.645026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.646292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.646610 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.648035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.657244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 69/124] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.657943 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.700634 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.771127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef49f8-4f27-42cc-a88d-134b07340a3e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.775137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59da6df-493e-4155-8423-7818c65a6ea6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.803768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.811527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.812239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.816784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.816784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.816784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.816784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.816784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.819546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.820163 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.820470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.820824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.821493 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.821799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.823175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.826917 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 56/125] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.827965 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.834481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 70/126] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.835651 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.949659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b0b0-2519-4c81-8d40-0ad315d5818a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.964897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645f3d-a763-4936-bd80-61ccebe83849 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.980405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.997008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.997961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.998269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.998545 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.000026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.001531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.006142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 71/127] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.006284 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.006398 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.006471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.006471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.006852 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.008665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.010473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.012247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 57/128] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.017793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.084834 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.131325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7793-8326-4b9d-a242-3059643685f3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.145595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c20a-b606-42bd-8f09-f0e0bdc42735 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.172895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.173550 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.173839 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.174334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.175280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.176859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.184113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 58/129] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.184113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.206274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.207272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.207749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.208278 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.211110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.213302 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.215452 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 72/130] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.216857 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.246501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.304999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ee0e-7a96-44eb-8d98-0079b721fd53 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.344286 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.345312 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.345864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.346362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.347720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.349430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.351520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 59/131] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.352514 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.352939 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74376-77aa-492c-9815-b3288ea2b75d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.378892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.399264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.400961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.401464 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.401942 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/8cee1245b8dd4379baa944422244c293/roles/bb2b6785ae6e468a941a62b4baff2705` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.404669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, user_id=8cee1245b8dd4379baa944422244c293, role_id=bb2b6785ae6e468a941a62b4baff2705)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.406624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.464495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad070-98f2-4b9e-abb6-b18f38666c31 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.492474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 73/132] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:58 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/8cee1245b8dd4379baa944422244c293/roles/bb2b6785ae6e468a941a62b4baff2705 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:58.492474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.499926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.538836 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.539492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.539774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.540056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] PATH_INFO: `/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.543034 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] RBAC: Authorizing `identity:get_project(project_id=b97d91ee36aa4447ae042e54b0a5d1f9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.544543 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.548106 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 60/133] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.554639 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.707486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349e1f-8134-43ce-82a8-bb67fef8717c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.752514 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.753552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.754057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.754546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.758071 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.759913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.763011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 74/134] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.764105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.788722 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804cba1-8a92-4a7d-8a94-f2131f6ca589 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.821657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.832327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.837208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.837208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.837208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/c1ea3af316ee47e789d80e3a6d797918/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.837208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, user_id=c1ea3af316ee47e789d80e3a6d797918, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.839068 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431b1e-6a0a-46a0-92e6-83529a700223 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.877509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6fbe3-b19f-4ebc-9f53-dcfc491b8d7e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.915407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.916525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.917033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.917562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] PATH_INFO: `/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9/users/8cee1245b8dd4379baa944422244c293/roles/686d6006762640dba07b0fb12570a686` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.920111 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b97d91ee36aa4447ae042e54b0a5d1f9, user_id=8cee1245b8dd4379baa944422244c293, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.921821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff5237-2b2f-4138-b9e0-56b4259538eb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.943037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 61/135] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:58 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/c1ea3af316ee47e789d80e3a6d797918/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:58.944947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c62c-7482-4f9f-b303-2244609d93ef None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.945536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c62c-7482-4f9f-b303-2244609d93ef None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.946042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c62c-7482-4f9f-b303-2244609d93ef None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.947642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 62/136] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:58.948704 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c62c-7482-4f9f-b303-2244609d93ef None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.008079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.035738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 75/137] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:58 2022] PUT /identity/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9/users/8cee1245b8dd4379baa944422244c293/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:59.037371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d7ab2-6d71-4680-8646-b08a692f4fb4 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.040005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d7ab2-6d71-4680-8646-b08a692f4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.040005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d7ab2-6d71-4680-8646-b08a692f4fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.081243 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-666d7ab2-6d71-4680-8646-b08a692f4fb4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:59.082818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-666d7ab2-6d71-4680-8646-b08a692f4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:59.130870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c62c-7482-4f9f-b303-2244609d93ef None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.206478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 76/138] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:59.234472 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.235180 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.235467 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.235750 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/8cee1245b8dd4379baa944422244c293/roles/686d6006762640dba07b0fb12570a686` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.242306 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, user_id=8cee1245b8dd4379baa944422244c293, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.243888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621c90-22fc-44b8-9e49-95357d555fd8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.331811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 63/139] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:58 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/8cee1245b8dd4379baa944422244c293/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:59.429833 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dd31-6785-43c3-9496-5604589386d5 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.430333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dd31-6785-43c3-9496-5604589386d5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.430403 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dd31-6785-43c3-9496-5604589386d5 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.431763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 77/140] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:59.437632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.438256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.438755 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.460390 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:59.461971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:59.535253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 64/141] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:59.595497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309dd31-6785-43c3-9496-5604589386d5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.652683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309dd31-6785-43c3-9496-5604589386d5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.782176 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.782875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.783155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.783425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.784570 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.786040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.787917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 78/142] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:59.795517 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.835357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.905448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88c0d1-5d16-491d-b8f4-53b0cf7b2912 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.942035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.943320 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.943846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.944143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.944959 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.946436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.951938 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.080147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1d7a-504f-488a-9fbc-588589032f39 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.089904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.120505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.121210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.121489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.121759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.133134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:00.138120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.139383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:00.140622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 79/143] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.145225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.166005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 65/144] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:11:59 2022] POST /identity/v3/users => generated 283 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:00.311982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa66e2-8705-4add-9de6-dd1d7abf04f2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.362965 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.363642 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.363923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.364252 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.365619 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:00.365994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.367502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.379848 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 80/145] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:00.387140 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.514794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.529698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b876-e35d-478b-b55e-55f65ed793bc None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.579587 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.581099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.581618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.582089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] PATH_INFO: `/v3/users/05a2b850b9064503849b1f14785e0cd8` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.583547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] RBAC: Authorizing `identity:get_user(user_id=05a2b850b9064503849b1f14785e0cd8)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.585381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.592330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 66/146] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/users/05a2b850b9064503849b1f14785e0cd8 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.594615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.631110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.727530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf1f8-6dab-4a01-aaed-bdb8210b6c0a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.773186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.774235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.774710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.775194 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.776546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.778204 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f68a-d9a5-4f03-b38a-757c88b8fc1f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.780196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 81/147] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.788120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.914207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1738-1385-4031-8979-cc02b133a51d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.957339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.959019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.959556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.960081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/05a2b850b9064503849b1f14785e0cd8/roles/ccaf3decf7434833abff4dd11aec3920` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.962423 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, user_id=05a2b850b9064503849b1f14785e0cd8, role_id=ccaf3decf7434833abff4dd11aec3920)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.964078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e08178-60b6-446d-9e0f-c4be230a5a3e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.114092 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 67/148] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:12:00 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/users/05a2b850b9064503849b1f14785e0cd8/roles/ccaf3decf7434833abff4dd11aec3920 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:12:01.653105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae2370-b47a-4f59-a28b-b51706881968 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.654256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae2370-b47a-4f59-a28b-b51706881968 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.654760 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae2370-b47a-4f59-a28b-b51706881968 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.656509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 82/149] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:01.663225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.664110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.664730 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.688421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:01.690155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:01.712621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.792152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 68/150] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:02.459681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae2370-b47a-4f59-a28b-b51706881968 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.578065 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.586041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae2370-b47a-4f59-a28b-b51706881968 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.629706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.630390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.630669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.631052 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.646577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:02.651432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:02.652286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:02.653123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:02.654147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 83/151] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:02.658302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.780266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9a897-e79e-4d47-86d3-b19dd3215236 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.816908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.817516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.818387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.818664 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.819512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.819872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.821278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ca27-8d04-46fb-81aa-ebb6ce533985 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.830148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 69/152] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.836681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.923230 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397baef4-0dc0-405b-a8e0-d58c4fe8bef7 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.923548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397baef4-0dc0-405b-a8e0-d58c4fe8bef7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.923767 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397baef4-0dc0-405b-a8e0-d58c4fe8bef7 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.925278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 70/153] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:02.926405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4942-a404-4412-bc61-994e2538da24 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.926756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4942-a404-4412-bc61-994e2538da24 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.927091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4942-a404-4412-bc61-994e2538da24 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.929161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 71/154] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:02.937381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.937653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.937925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.959584 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239bcd-4bb5-4f78-85e7-98bd002a291d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.972389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:02.973844 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:02.985195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.996680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.997373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.997660 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.997942 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.002724 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.004266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eaf39-e91d-4a96-b8ba-dcc81bf801a8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.009292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 84/155] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.010534 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.010822 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.011106 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.057461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:03.058697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:03.088481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 72/156] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:03.089581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.113137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.250103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 85/157] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:03.259999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eaf62-c00d-4488-b108-fb3a65b9dd12 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.331491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.332110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.332390 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.332687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.352964 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.437066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.438527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.560009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 73/158] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:03.565692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.712711 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843b07-08c8-4a74-90db-4968d543deff None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.756299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.757341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.757826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.758580 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.765121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.766820 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a156ded-5885-4649-bbd3-d7c523dafd44 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.768732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 86/159] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.775187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.850718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691ec5-e4ba-4503-8ee7-187280208814 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.851347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691ec5-e4ba-4503-8ee7-187280208814 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.851828 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691ec5-e4ba-4503-8ee7-187280208814 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.852661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.853441 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 87/160] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:03.869187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.869783 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.870226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.913453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:03.915097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:03.930591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804a67-0c6b-4864-a99d-7dcd80ddf2c0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.948170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.994649 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.995511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.995937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.996348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.997252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] RBAC: Adding query filter params (role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.997704 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.006517 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.018822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 74/161] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:04.020013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.070997 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 88/162] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:04.088028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.221633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd440-9e58-41d4-8d7b-26ee4bf07532 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.242438 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.290721 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.291579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.292000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.292527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.311374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:04.316669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:04.317591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:04.318584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:04.321362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 75/163] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:04.328124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.354884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53defefd-31c2-49bd-be48-bc4b55d475eb None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.449265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.449927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.450216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.450498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.481583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:04.486408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:04.487256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:04.488495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 89/164] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:04.495647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.527455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.557527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565688-d874-4f08-b7f3-1e7fc7d603e0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.636390 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.637289 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.637712 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.638124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.639059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.639563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.641167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.660511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 76/165] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:04.668148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.733750 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.740738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4a30-8d6f-424c-b738-7c6415420648 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.833274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.833886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.834169 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.834442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.835121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.835425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.838792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.852362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 90/166] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:04.857980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.890901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3b09-ae82-4b48-a028-f401f78bd06b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.968884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.969790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.970211 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.970623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] PATH_INFO: `/v3/users/c1ea3af316ee47e789d80e3a6d797918` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.972025 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] RBAC: Authorizing `identity:get_user(user_id=c1ea3af316ee47e789d80e3a6d797918)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.974894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.980824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 77/167] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/users/c1ea3af316ee47e789d80e3a6d797918 => generated 247 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:04.981901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.015109 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.043383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd196ba-fcbe-4935-b0a1-96d261c7f4c5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.103218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.104215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.104727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.105174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.109148 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.110866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7135515-e2c6-40a5-89b6-931677c818b8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.112707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 91/168] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:05.114195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2b04-e843-4f69-918b-09c197b80c37 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.114676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2b04-e843-4f69-918b-09c197b80c37 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.115740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2b04-e843-4f69-918b-09c197b80c37 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.117266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 92/169] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:05.118205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf2b04-e843-4f69-918b-09c197b80c37 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.156394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.167501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ff625-d9c7-4db0-9651-5c243e6187ce None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.244365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.245131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.245412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.245792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.257847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-0f298153-31a9-4f6d-ac18-b7ffe6a6135b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:05.269589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:05.270537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:05.272064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 78/170] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:05.275595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.276072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.276362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.300091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf2b04-e843-4f69-918b-09c197b80c37 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.313773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:05.314994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:05.369014 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.369551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.369837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.370113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.392322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.438453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 79/171] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:05.439773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.449996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.451635 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.590772 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.614489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce101c75-a885-4ebd-97a3-76eedfa7013b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.618759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 93/172] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:05.619500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.684168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.690533 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.691207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.691494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.691769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.750148 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e09468-ce32-4e9b-8bee-51b611b7ab95 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.794467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.795377 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.795748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.796028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.797123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:05.797430 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.798940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8741c-d25c-4cef-b10d-bf3cb51d8512 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.811033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 94/173] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:05.813026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f164-9c88-4429-a952-77afc35c395c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.813228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f164-9c88-4429-a952-77afc35c395c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.813513 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f164-9c88-4429-a952-77afc35c395c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.814885 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 95/174] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:05.815498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f164-9c88-4429-a952-77afc35c395c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.870047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.871483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.955880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f164-9c88-4429-a952-77afc35c395c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.959957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.995742 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.996475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.996769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.997047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.998320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.999743 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890a460-61b0-4490-9995-cc0e8d5806ee None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.003184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.005173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 96/175] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.007352 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.007643 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.007922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.023894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 80/176] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:06.024674 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.032618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:06.034287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:06.102941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 97/177] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:06.105334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.129297 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b19de-0133-4129-9bb1-1d8c949d0364 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.170431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.171059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.171339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.171610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] PATH_INFO: `/v3/users/8cee1245b8dd4379baa944422244c293` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.172993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] RBAC: Authorizing `identity:get_user(user_id=8cee1245b8dd4379baa944422244c293)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.174441 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f994fe-5fbb-4493-b08e-0ec453b017c0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.176328 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 81/178] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/users/8cee1245b8dd4379baa944422244c293 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.178200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb035-5713-4e7b-991e-1c9c2e69b408 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.178545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb035-5713-4e7b-991e-1c9c2e69b408 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.178877 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb035-5713-4e7b-991e-1c9c2e69b408 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.184252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 82/179] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:06.184252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb035-5713-4e7b-991e-1c9c2e69b408 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.211199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6961d8-3d83-4218-92d8-2f3737250435 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.213215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.249918 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.256493 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.257139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.257421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.257822 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.268409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:06.273453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:06.274357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:06.275142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 98/180] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:06.276384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.304841 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb035-5713-4e7b-991e-1c9c2e69b408 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.339643 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.340363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.340676 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.340951 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.341737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=c1ea3af316ee47e789d80e3a6d797918) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:06.342048 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.343806 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05dce7-b552-4d69-b7c1-edd81acd914c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 83/181] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/role_assignments?user.id=c1ea3af316ee47e789d80e3a6d797918&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=27562aa899b24a498ff1887ceca94449 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507804-1922-49da-91cf-eda6b25a4b9d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507804-1922-49da-91cf-eda6b25a4b9d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507804-1922-49da-91cf-eda6b25a4b9d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 84/182] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:06.356647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6507804-1922-49da-91cf-eda6b25a4b9d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.397008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca381-d8bb-48c9-857b-863c95cb949a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.439585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.440329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.440801 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.441084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] PATH_INFO: `/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.442518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] RBAC: Authorizing `identity:get_project(project_id=b97d91ee36aa4447ae042e54b0a5d1f9)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.444895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a4437-6879-4971-9c47-76f76ca68b5d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.447387 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 99/183] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/projects/b97d91ee36aa4447ae042e54b0a5d1f9 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.448918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.449318 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.449589 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.473409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:06.475141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:06.493680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6507804-1922-49da-91cf-eda6b25a4b9d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.506766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.514963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.533175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.533796 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.534081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.534356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.562875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 100/184] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:06.564033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.625650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.627134 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.700945 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc5cd-3148-4e2c-b92a-4896c224fb71 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.740821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.741529 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.741809 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.742080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.742778 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:06.743078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.748382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b039a5-082f-4f2b-891e-614fe66583d2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.757922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 101/185] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.759707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26741-090e-4d55-9036-89feb119969c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.759994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26741-090e-4d55-9036-89feb119969c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.760272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26741-090e-4d55-9036-89feb119969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.760679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 85/186] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:06.761726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.783203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a1e26741-090e-4d55-9036-89feb119969c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:06.784883 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a1e26741-090e-4d55-9036-89feb119969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:06.801494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.805043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.875916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 102/187] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:06.877351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26741-090e-4d55-9036-89feb119969c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.901281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ed25c-d9f3-4015-a65f-259629073630 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.967923 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.968870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.969513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.969978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.984733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:06.992866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:06.993743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:06.994621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:06.996709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 86/188] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:06.997631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.017607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26741-090e-4d55-9036-89feb119969c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.083808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.084430 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.084735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.085010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.085742 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b97d91ee36aa4447ae042e54b0a5d1f9, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.086053 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.087500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.095660 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 103/189] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=b97d91ee36aa4447ae042e54b0a5d1f9&role.id=686d6006762640dba07b0fb12570a686 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.096241 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.112879 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.132795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.150092 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f71016-8531-4ab6-8089-e667b9d4a745 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.232395 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.233154 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.233503 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.233788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] PATH_INFO: `/v3/users/05a2b850b9064503849b1f14785e0cd8` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.235762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] RBAC: Authorizing `identity:get_user(user_id=05a2b850b9064503849b1f14785e0cd8)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.237299 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.239181 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 87/190] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/users/05a2b850b9064503849b1f14785e0cd8 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.239880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.277692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99bcc-313d-4b3f-81a8-296745cda9ce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.316371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.317044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.317329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.317606 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.319729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.321228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.322885 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 104/191] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.323657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.363378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2c58-7218-47d5-8a70-01f4bbd9aabd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.405499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.406133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.406435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.406707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.417812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:07.422056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:07.422978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:07.424024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:07.425208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 88/192] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:07.429269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.438840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.440855 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90874e-5a96-40e8-8061-50d2757da9bf None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.476392 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.476964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.477246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.477530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.478190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.478566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.479907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.487855 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 105/193] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.488691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.532770 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af2f82-7218-4947-97fb-0341f7817071 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.566030 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.566657 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.566938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.567209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.568595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.570037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.571590 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 89/194] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.572354 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.585774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bef0e-9306-4226-9e72-ea1aa93f2506 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.619263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.619868 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.620155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.620428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.636492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.650280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.675079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe32652-6436-46e6-ba20-3c1bc2716139 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.689795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.691436 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.709128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.709853 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.710133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.710443 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.711126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=8cee1245b8dd4379baa944422244c293) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.711433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.712883 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.718488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 90/195] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/role_assignments?user.id=8cee1245b8dd4379baa944422244c293&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=686d6006762640dba07b0fb12570a686 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.719258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.805291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 106/196] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:07.806844 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.838987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015ee2-29df-4176-938c-745c0b40f75e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.860378 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.879347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.879979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.880265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.880581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.881273 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.881585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.882990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.888981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.898684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 91/197] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.898684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.930494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0fd0-308a-49d4-938d-b70889b7854a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.971816 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.972487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.972772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.973045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.988572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.990638 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.992394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 107/198] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.993195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.009367 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a22b1-707b-4116-bbc0-df686c5ce14b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.045069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.045677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.045972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.046247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.046895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.048342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.093063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242566c-08cb-4536-aae7-20663cee0da6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.095271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.126200 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.126829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.127113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.127389 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.128530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.129985 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.131633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 108/199] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.132387 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.149701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 92/200] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:07 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:08.150569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.217420 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.266273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd896ce1-c269-4bf9-ba7e-8beaf8fba077 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.270045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ce1f-ab8c-48ae-9a65-bdeb58b74d5a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.305879 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.306532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.306814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.307088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.308575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.309952 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.310889 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.311516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.316396 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.316587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 109/201] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.316681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.316803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.366474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.400351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.401869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.441308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973032-3c05-4d0e-891b-ea7cce4daa5b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.474621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.493720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.494370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.494658 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.494937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.495667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, scope.project.id=03ee74f9b79d449eb98654a164f1ba41, user.id=05a2b850b9064503849b1f14785e0cd8) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:08.495984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.497543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.504053 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 110/202] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/role_assignments?user.id=05a2b850b9064503849b1f14785e0cd8&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.505420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.547653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 93/203] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:08.555370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.643010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b112e5-ca3b-4fe0-bd57-b471c992ea37 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.646015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.695763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.698762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.699361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.700217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.763688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddde5-bcf0-4fdc-a08d-da38b30723c1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.807867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.808902 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.809411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.809641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.810419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.811308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.812787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.814451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.816351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 94/204] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:08.822363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.861568 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.934901 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 111/205] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:08.940262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.943593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.957232 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8028-c078-4a6f-bbd5-f23943b4a084 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.995231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.995854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.996138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.996415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.997199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=60dbc72acd9e40e69661d29791673ba7) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:08.997518 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.998991 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.005075 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 95/206] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/role_assignments?user.id=60dbc72acd9e40e69661d29791673ba7&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=27562aa899b24a498ff1887ceca94449 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:09.054505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00330e7-4668-444e-9052-538b8ad312c5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.094548 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.095209 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.095491 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.095768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.097004 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.098575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e5da0-5e13-4891-b2a3-d99694b144ce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.101339 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 112/207] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:09.107412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:09.210275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:09.223194 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c800f00-d909-416e-97ee-588e3201fc91 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.260382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.261064 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.261349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.261682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.262414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] RBAC: Adding query filter params (role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=60dbc72acd9e40e69661d29791673ba7) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:09.262746 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.264336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c480865-f7fc-4b2b-aaab-bab7cca08448 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.270165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 96/208] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:09 2022] GET /identity/v3/role_assignments?user.id=60dbc72acd9e40e69661d29791673ba7&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:10.669028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c84b7-85ae-49af-9ec7-32d2d17181f7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.669542 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c84b7-85ae-49af-9ec7-32d2d17181f7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.669618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c84b7-85ae-49af-9ec7-32d2d17181f7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.670922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 113/209] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:10.676155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.676616 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.676790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.696031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:10.697278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:10.709134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73847fd-e4c2-4b6f-8ed2-7a092276b1be None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.709507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73847fd-e4c2-4b6f-8ed2-7a092276b1be None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.709784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73847fd-e4c2-4b6f-8ed2-7a092276b1be None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.711191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 114/210] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:10.717554 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.717952 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.718328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.737376 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:10.738737 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:10.770021 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 97/211] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:10.815560 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 115/212] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:11.104813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.157467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.159858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.198130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.222805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dc101-2633-4d04-99df-eb26e54b28cb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.288043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.288043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.288043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.288043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.288407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fabcc-2c89-499b-8ded-0a47c8476e3a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.288516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:11.294415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:11.295302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:11.296480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 98/213] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:11.301272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.322325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.322958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.323237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.323508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.324645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.326084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84aa7-2fdf-4916-bac1-1f9b765206d9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.327635 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 116/214] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:11.333360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e204c9-1903-4f69-830a-46a88119d0dd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.333595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e204c9-1903-4f69-830a-46a88119d0dd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.334522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e204c9-1903-4f69-830a-46a88119d0dd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.336588 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 117/215] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:11.336704 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e204c9-1903-4f69-830a-46a88119d0dd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.412699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c401a1-33f1-48a3-9d80-740b8a381ec5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.419990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.447617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.448228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.448671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.448937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.449605 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:11.449911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.451280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b62b2-119c-4c25-9166-ef7c62650219 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.452101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e204c9-1903-4f69-830a-46a88119d0dd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.460376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 99/216] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:11.463329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.464149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.464463 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.474402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.485681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:11.486905 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:11.494564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.495172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.495451 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.495718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.496555 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.497923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4630d3-e379-4379-b527-5471141a04e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.556538 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 100/217] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:11.557325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.629338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 118/218] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:11 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:11.631434 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259762-7e31-45e5-b23d-a3f46edd569a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.632358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259762-7e31-45e5-b23d-a3f46edd569a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.632894 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259762-7e31-45e5-b23d-a3f46edd569a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.634766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 119/219] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:11.640865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.641157 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.641442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.664556 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:11.665721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:11.677467 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff936bc-ac4b-496e-a745-e4a8a91b4bc2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.719690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.720947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.721437 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.721920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] PATH_INFO: `/v3/users/5aaacf496d7547ce8cf0f05d768b3017` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.725804 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.742709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] RBAC: Authorizing `identity:get_user(user_id=5aaacf496d7547ce8cf0f05d768b3017)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.744576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.746505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 101/220] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/users/5aaacf496d7547ce8cf0f05d768b3017 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:11.748575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 120/221] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:11.759448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.873059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835a0f-feba-4a1d-9e18-ee24ca27517f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.902972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.910506 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.911407 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.911969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.912532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.982302 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.990860 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.006577 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.009555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.051003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ba299-193c-458b-8326-8b8a8b7607af None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.108083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.108759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.109037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.109305 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.122676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:12.128250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:12.129190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:12.129989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 121/222] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:12.135669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.141807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 102/223] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:12.142850 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.270502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.280393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847bf88-c47a-460e-a2d7-bbba1356d3ca None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.289902 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2226a7-e66b-4537-a484-e9f8420d0712 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.300769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.321746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.322415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.322694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.322971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.335184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:12.337481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.338331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.338817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.339318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:12.340130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:12.341185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:12.341996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 122/224] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:12.342648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.348225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.350328 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.351965 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.363739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 103/225] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.365817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.455650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade900e-4e01-4f20-b123-3dfb3c29c778 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.491474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.492119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.492404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.492727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.493979 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.495467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.497291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 123/226] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.497891 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.501752 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e44a1-90a4-44f0-9204-5f3bd1491390 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.551817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.552201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.554038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.554825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.555307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.556348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.557149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.558733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.571316 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 104/227] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.576956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.604431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.626738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1541a56-da9f-4a52-b2a5-e72905c9911f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.686637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.687896 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.688566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.689172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.691192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.694680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.697750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 124/228] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.699329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.713784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836219-5b87-41ec-901f-8c502e756f52 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.758276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.760239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.760718 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.761143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.762019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=5aaacf496d7547ce8cf0f05d768b3017) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.762499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.764081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.770388 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 105/229] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/role_assignments?user.id=5aaacf496d7547ce8cf0f05d768b3017&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=686d6006762640dba07b0fb12570a686 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.771421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.873871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619a5ad-2c00-431d-af1c-45049a862bf4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.893091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.936320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.937379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.937868 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.942103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.945421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.947172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.949592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 125/230] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.954832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.967302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.020399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244ea1-7abc-4bdd-9216-d34febd5575d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.072008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.072985 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.073451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.073905 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.076520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.078210 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.080124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 106/231] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:13.093446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.109381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443444e-12b9-485a-aedd-8dd39392c6e7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.150224 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.150871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.151153 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.151438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.158249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.159755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.163014 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 126/232] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:13.169209 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.282762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.314090 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb776-62d1-4a92-9387-5f9ab9b79b78 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.362185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.362870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.363158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.363442 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/users/60dbc72acd9e40e69661d29791673ba7/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.366298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, user_id=60dbc72acd9e40e69661d29791673ba7, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.367775 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80277912-3e25-4040-9fe9-15fa0361913a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.378528 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293566f-61c7-4bc4-a793-a693977c97f1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.416002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.416728 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.417023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.417306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/users/60dbc72acd9e40e69661d29791673ba7/roles/bb2b6785ae6e468a941a62b4baff2705` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.419819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, user_id=60dbc72acd9e40e69661d29791673ba7, role_id=bb2b6785ae6e468a941a62b4baff2705)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.421401 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149eb55-f984-4bc4-aa60-ce4f98045c4d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.451083 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 107/233] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:12:13 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/users/60dbc72acd9e40e69661d29791673ba7/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:13.512455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 127/234] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:12:13 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/users/60dbc72acd9e40e69661d29791673ba7/roles/bb2b6785ae6e468a941a62b4baff2705 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:12:14.398906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da48ac-8d33-48b1-b956-8bc8205361ec None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.399411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da48ac-8d33-48b1-b956-8bc8205361ec None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.399516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da48ac-8d33-48b1-b956-8bc8205361ec None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.401091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 108/235] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:14.405998 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.406399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.406592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.429892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:14.431561 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:14.432934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814b6d-9407-4860-8c13-aa85c93ba598 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.433226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814b6d-9407-4860-8c13-aa85c93ba598 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.433505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814b6d-9407-4860-8c13-aa85c93ba598 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.435099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 109/236] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:14.439772 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.440062 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.440344 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.469598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:14.470916 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:14.475550 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.541827 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 128/237] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:14.579460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 110/238] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:15.009906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.056054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.097409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.158826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526af5-cc76-4348-b626-49293281b5a5 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.209192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.210156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.210440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.210779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.223064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621eafa-26ee-46cb-a2b2-5c552fc69bd6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.239055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.253415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:15.259505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:15.260512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:15.261330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:15.268170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.268854 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.269139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.269418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.276244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.276244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.276474 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 111/239] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:15.276602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 129/240] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.283827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.284056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.463432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db391148-d729-4a27-822c-f894a9f6fdfb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.485018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9bc4-b64d-4620-b587-08dcad032d0b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.492787 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.500475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.501164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.501511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.501855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.502647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:15.502950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.504329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ec596-b93f-4049-aa88-159439ba9062 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.514103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 112/241] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.519236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c94e7-0742-40e9-88ab-5aeea7aa66cf None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.519584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c94e7-0742-40e9-88ab-5aeea7aa66cf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.519811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c94e7-0742-40e9-88ab-5aeea7aa66cf None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.521131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 113/242] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:15.522522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c94e7-0742-40e9-88ab-5aeea7aa66cf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.525025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.525920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.526418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.526882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.527744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.530623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906b3d-16fc-4a52-9103-8ecf64fade69 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.592786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.637501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c94e7-0742-40e9-88ab-5aeea7aa66cf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.642130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 130/243] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:15 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:15.652147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.652488 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.653919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.690735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:15.691965 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:15.709855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.710633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.711067 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.711342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] PATH_INFO: `/v3/users/a261fbd594694ea891eb14fc8070797c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.742678 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] RBAC: Authorizing `identity:get_user(user_id=a261fbd594694ea891eb14fc8070797c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.744150 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.747474 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 114/244] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/users/a261fbd594694ea891eb14fc8070797c => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.754190 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.883998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c912-eeb8-4e88-923c-1a62298239ef None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.900469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 131/245] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:15.908091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.927398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.929077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.929623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.930099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.007442 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.009730 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207668f3-5130-41b9-b282-cb46bd9eab70 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.164420 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 115/246] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:12:16.171379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.194731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2430-7fae-4c34-9e22-3cb4f29bb25f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.195056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2430-7fae-4c34-9e22-3cb4f29bb25f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.195293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2430-7fae-4c34-9e22-3cb4f29bb25f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.196849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 116/247] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:16.203162 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.203445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.203725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.235090 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:16.236655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:16.252193 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.302372 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.312789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816dde-1679-44a3-9d3d-56533adfc992 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.328759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 117/248] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:16.329239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.362679 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.363321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.363603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.363878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.365923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.367576 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc343-c55a-4acf-93c7-16ac90e4e313 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.369611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 132/249] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.371059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b6a1-a0af-4778-93b3-573d6a2515a2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.371391 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b6a1-a0af-4778-93b3-573d6a2515a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.371574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b6a1-a0af-4778-93b3-573d6a2515a2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.376994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 133/250] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:16.378694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b6a1-a0af-4778-93b3-573d6a2515a2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.462476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9dac-3b79-4424-b9eb-415ebeafec11 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.504581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b6a1-a0af-4778-93b3-573d6a2515a2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.506956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.507882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.508229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.508534 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.520031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-afe13816-e31f-4647-8502-1caf8b196adb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:16.525986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:16.526884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:16.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:16.531938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 118/251] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:16.533297 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.533590 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.533867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.548796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.549853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.550337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.550830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.551759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=a261fbd594694ea891eb14fc8070797c) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.552268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.554299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.565774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:16.566121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 134/252] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/role_assignments?user.id=a261fbd594694ea891eb14fc8070797c&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.567506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.569044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:16.572733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.632836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.741967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 119/253] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:16.768297 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a78e1-fd67-4e19-bf69-1f9fe6b4faf5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.789249 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.842026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.842657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.842938 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.843212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.843889 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.844191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.845644 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.862192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 135/254] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.869615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.002240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860a53d-6a99-47ad-946c-1d7557e313fb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.036725 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.067958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed357c-0400-4280-8061-ab499932c6fa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.081933 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.082919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.083398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.083871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.098804 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.107467 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:17.116623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:17.118840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:17.119629 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:17.121989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 120/255] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:17.129296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.159237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.160197 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.160763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.161239 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] PATH_INFO: `/v3/users/5aaacf496d7547ce8cf0f05d768b3017` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.163786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] RBAC: Authorizing `identity:get_user(user_id=5aaacf496d7547ce8cf0f05d768b3017)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.171686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.177646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 136/256] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/users/5aaacf496d7547ce8cf0f05d768b3017 => generated 297 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.183559 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.291091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef157e-2e88-4074-8369-ee78f8d8b8b4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.329120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.329735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.330014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.330287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.330956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:17.331261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.332673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.358368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 121/257] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.359545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.380780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027af9-f177-4a30-8490-47ec90a93282 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.421268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.422398 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.423151 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.423657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.425067 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.426710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.430279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 137/258] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.431546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.482567 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.491314 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.573036 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841b8b-4e24-421a-8cce-a6844133ddbb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.624328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7a03-2e81-4e2b-9c5f-321f84a4a306 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.653999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.654659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.654944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.655222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.674504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:17.680627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:17.681565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:17.682355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:17.688392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 122/259] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:17.689205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.696875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.698033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.698033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.698033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.699751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.701230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.710725 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 138/260] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.711550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.862680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e82e-b0e7-44c6-b97d-844c19f6ac17 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.868977 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.878709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536a7d-2fb7-4f6e-933c-5b7298794f6a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.909238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.914941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.915339 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.915619 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.915865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.916523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:17.916836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.918516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.927201 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 139/261] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.928599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.954514 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.955198 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.955491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.955795 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/users/5aaacf496d7547ce8cf0f05d768b3017/roles/686d6006762640dba07b0fb12570a686` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.965219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, user_id=5aaacf496d7547ce8cf0f05d768b3017, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.966714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.032762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f17-da51-4d6e-9895-656366c6c62c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.041980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 123/262] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:12:17 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/users/5aaacf496d7547ce8cf0f05d768b3017/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:18.042824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.100470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.100470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.100470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.100470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.123618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.176578 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.180708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.276618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f4cf9-d1b6-4b74-80fc-99ffe779e0d0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.356920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.357591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.357879 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.358166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] PATH_INFO: `/v3/users/60dbc72acd9e40e69661d29791673ba7` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.359480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] RBAC: Authorizing `identity:get_user(user_id=60dbc72acd9e40e69661d29791673ba7)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.361069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.362707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 124/263] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/users/60dbc72acd9e40e69661d29791673ba7 => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.368706 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.369038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 140/264] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:18.380530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.428960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.467078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.485749 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a534-49cf-4fdf-9711-ea60d867dd33 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.527915 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.528828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.529259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.529680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.535414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af818c-843a-43b3-9a0a-9ee829ffea01 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.578432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.579238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.579632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.580024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.582976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.585199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.596462 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 141/265] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.613472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.626455 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.628575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.683019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.744261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 125/266] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:12:18.753256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.775575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c656-e936-46f3-9a25-4a75c0fd0698 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.796917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.825046 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.826062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.826577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.827058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.829056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] RBAC: Adding query filter params (role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=60dbc72acd9e40e69661d29791673ba7) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.829594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.831273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075afa4-2173-4eaa-896d-359870af0393 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.843037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 142/267] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/role_assignments?user.id=60dbc72acd9e40e69661d29791673ba7&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.887993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469705-90ef-498b-91f3-479f7e9856e0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.905831 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ada-16c1-4a16-a744-abcc8e5e7287 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.906467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ada-16c1-4a16-a744-abcc8e5e7287 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.907063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ada-16c1-4a16-a744-abcc8e5e7287 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.908899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 143/268] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:18.926179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f8a5-1c23-457d-b98f-9fd8fe883cb0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.926801 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f8a5-1c23-457d-b98f-9fd8fe883cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.927286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051f8a5-1c23-457d-b98f-9fd8fe883cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.933847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.934441 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.934726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.935029 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.936218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.939771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.939771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 126/269] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:18.946392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.965129 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d051f8a5-1c23-457d-b98f-9fd8fe883cb0 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:18.966731 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d051f8a5-1c23-457d-b98f-9fd8fe883cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:18.973500 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.110109 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 144/270] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:19.164008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74977f-5591-4a47-a1cf-e9239534b31b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.200555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.201147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.201433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.201714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.202444 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=60dbc72acd9e40e69661d29791673ba7) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:19.202757 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.204224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb239f-59fb-4ab4-ae13-f6c988333368 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.210641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 127/271] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/role_assignments?user.id=60dbc72acd9e40e69661d29791673ba7&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=27562aa899b24a498ff1887ceca94449 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:19.265387 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b995f-d9b2-4330-ab69-96fd1746844c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.265717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b995f-d9b2-4330-ab69-96fd1746844c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.265969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b995f-d9b2-4330-ab69-96fd1746844c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.267687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 145/272] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:19.273817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.274118 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.274465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.302191 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:19.303977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:19.389218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 128/273] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:19.576909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b995f-d9b2-4330-ab69-96fd1746844c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.706396 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b995f-d9b2-4330-ab69-96fd1746844c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.722453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.749964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.750615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.750899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.751174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.767374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:19.775531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:19.778710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:19.779505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 146/274] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:19.782816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.802243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.811083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.919604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0018a9-8f8c-4a7a-ae69-2c018360f2da None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.943360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8044094-e486-41f2-8679-03eb5fd79a51 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.963392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.964009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.964293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.964604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.965279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:19.965588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.967010 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f201f5e-4020-4b9d-824b-d72efa467c26 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.976147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 129/275] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:19.977294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b686-4f49-4bd0-a9eb-f33ae730c3bb None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.977585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b686-4f49-4bd0-a9eb-f33ae730c3bb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.977866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b686-4f49-4bd0-a9eb-f33ae730c3bb None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.979219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 130/276] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:19.984128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b686-4f49-4bd0-a9eb-f33ae730c3bb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.986482 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.990494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.990494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.990494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.990494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.990494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900af3f-e01b-4561-9f44-28a3fb7d9343 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.996417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 147/277] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:19.996417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.996417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.996417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.013045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:20.014340 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:20.052935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.066197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.085414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 148/278] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:20.086614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.124057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b686-4f49-4bd0-a9eb-f33ae730c3bb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.171256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.172312 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.172837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.173331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] PATH_INFO: `/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.192345 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] RBAC: Authorizing `identity:get_user(user_id=8be9dddfd57740f1b4d8b9ec5afc9bbf)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.195548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.198700 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 131/279] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:20.204317 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.206724 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8868-8437-4157-bb71-9dfc0cd76b1a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.257068 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.257742 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.258028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.258306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.258994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.260741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.332702 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa782-d39c-4f19-b529-a1b78e92b050 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.364087 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.370364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.371238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.371725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.372279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.373231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, user.id=8be9dddfd57740f1b4d8b9ec5afc9bbf, scope.system=all) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.373744 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.375371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.381091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 132/280] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/role_assignments?user.id=8be9dddfd57740f1b4d8b9ec5afc9bbf&scope.system=all&role.id=686d6006762640dba07b0fb12570a686 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.387803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 149/281] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:20 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:20.428864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.560898 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405b62f-80a1-488e-9e8c-34c46bbd1f6e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.605217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.605861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.606214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.606421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.617977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:20.623234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.624309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:20.625224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 133/282] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.633576 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.676059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.753924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910a6-97af-4ec3-be06-b47cf922786e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.793138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.794527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.794817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.795091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.795774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.796078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.799819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.807194 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 150/283] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.813149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.888003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.966198 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0e1a8-5bbb-4c47-9e62-73a2780beb3e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.020748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.022404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.023001 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.023484 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] PATH_INFO: `/v3/users/a261fbd594694ea891eb14fc8070797c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.024911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] RBAC: Authorizing `identity:get_user(user_id=a261fbd594694ea891eb14fc8070797c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.026779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399be3f-6d89-4975-9c6e-3e2ef2f8940e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.030923 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 134/284] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/users/a261fbd594694ea891eb14fc8070797c => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:21.039250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.074669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b09584-7a8c-4c6f-b2a3-83aa0f5e58a4 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.075286 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b09584-7a8c-4c6f-b2a3-83aa0f5e58a4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.075769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b09584-7a8c-4c6f-b2a3-83aa0f5e58a4 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.077677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 135/285] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:21.083571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.084096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.084680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.114111 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:21.116263 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:21.181483 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.200715 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01904e6-e342-49b5-b6fc-4e5cc2dad807 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.244955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.248332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.248678 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.248959 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.250800 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.253140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.254964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 151/286] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:21.263940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.276841 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 136/287] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:21.378485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a818-fd83-486a-bca7-93ccfb402bd7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.423657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.424331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.424645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.424925 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/users/a261fbd594694ea891eb14fc8070797c/roles/ccaf3decf7434833abff4dd11aec3920` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.426912 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, user_id=a261fbd594694ea891eb14fc8070797c, role_id=ccaf3decf7434833abff4dd11aec3920)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.428619 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.508226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 152/288] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:12:21 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/users/a261fbd594694ea891eb14fc8070797c/roles/ccaf3decf7434833abff4dd11aec3920 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:21.664797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.734461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.801986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d5e4d-7086-42da-b644-54404b0b83a4 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.843241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.843875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.844152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.844421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.856258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:21.861239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:21.862164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:21.862960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:21.866041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 137/289] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:21.872219 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.895669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.994540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab86d6f-84f5-4161-a0fe-f20723660667 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.044185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.044853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.045143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.045424 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.046113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:22.046425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.047820 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.057571 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 153/290] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:22.064799 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.223444 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8024-0a0b-4a32-9443-ebe60f7f8af4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.246237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.279243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.280248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.280751 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.281226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] PATH_INFO: `/v3/users/5aaacf496d7547ce8cf0f05d768b3017` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.282592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] RBAC: Authorizing `identity:get_user(user_id=5aaacf496d7547ce8cf0f05d768b3017)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.284536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.286765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 138/291] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/users/5aaacf496d7547ce8cf0f05d768b3017 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:22.293313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.390336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.417990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768464-b7ca-47d3-8a39-bb621824f2e6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.458795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.459996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.460408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.460729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.532743 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.534141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.618993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.639402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 154/292] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:22.645250 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.807986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf3a8-4565-45a8-8774-824d92eec446 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.848499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.850110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.850618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.851086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.852733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.854394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35daa6a-9ef8-46b4-875f-83c602f4446c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.856594 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 139/293] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:22.862364 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.873205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208941d0-0e82-4b27-ae90-e779dcea043b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.873761 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208941d0-0e82-4b27-ae90-e779dcea043b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.874254 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208941d0-0e82-4b27-ae90-e779dcea043b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.875995 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 140/294] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:22.880673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.880968 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.881777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.914908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:22.916137 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.004823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.037260 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 141/295] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:23.078507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5107-e04a-45bf-8c05-19c8c1e619c8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.134554 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.135433 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.135716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.135993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.136759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=5aaacf496d7547ce8cf0f05d768b3017) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:23.137070 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:23.138537 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63ea3-c1ec-4d8e-b661-e7b1a4fb8381 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:23.149875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 155/296] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/role_assignments?user.id=5aaacf496d7547ce8cf0f05d768b3017&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=686d6006762640dba07b0fb12570a686 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:23.469410 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.549963 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251b50b-0731-430a-b907-ba5b56922c25 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.550696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251b50b-0731-430a-b907-ba5b56922c25 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.550984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251b50b-0731-430a-b907-ba5b56922c25 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.554195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 156/297] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:23.558162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac3ee-fdaa-4747-bcb3-954831ee31f1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.558458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac3ee-fdaa-4747-bcb3-954831ee31f1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.558738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac3ee-fdaa-4747-bcb3-954831ee31f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.587229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9c4ac3ee-fdaa-4747-bcb3-954831ee31f1 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:23.588599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9c4ac3ee-fdaa-4747-bcb3-954831ee31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.598133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bee97-2145-4588-b038-578ce539bbfb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.649783 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.730641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.730641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.730641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.731150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:23.731295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:23.734963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:23.737621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 142/298] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:23.739435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.739577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 157/299] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:23.739734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.791585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be966436-9e6a-46ce-817c-7308501f6ab3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.803230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172039c-c1eb-4adc-93ac-ebb7d0ee1f7f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.803520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172039c-c1eb-4adc-93ac-ebb7d0ee1f7f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.803676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172039c-c1eb-4adc-93ac-ebb7d0ee1f7f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.808759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 158/300] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:23.812465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.812465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.812465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.829397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.830013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.830305 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.830582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.831254 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:23.831365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:23.831549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:23.832969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:23.833085 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.847851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 143/301] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:23.849419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.928717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 159/302] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:23.962674 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a78132-0717-4fb3-9a40-a3ed52d5c39b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.997608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.998475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.998906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.999325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] PATH_INFO: `/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.000640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] RBAC: Authorizing `identity:get_user(user_id=8be9dddfd57740f1b4d8b9ec5afc9bbf)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.002225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.004233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 144/303] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.011351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.041988 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.138436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.142267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286588-0788-428f-bf93-eeb6fe1535a2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.146112 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.156657 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d277d-3c34-46af-8ddb-04a11e05681e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.181626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.184526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.189955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.189955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] PATH_INFO: `/v3/system/users/8be9dddfd57740f1b4d8b9ec5afc9bbf/roles/686d6006762640dba07b0fb12570a686` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.189955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8be9dddfd57740f1b4d8b9ec5afc9bbf, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.189955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b6ea5-2025-48c9-95e9-9e1956a9d312 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.194524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.195097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.195380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.195712 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.196897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.198391 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.200184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 145/304] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:24.205357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.247281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.310645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e9897-6698-4e98-b212-82be1791d200 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.327250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 160/305] 10.222.0.91 () {58 vars in 1334 bytes} [Tue Aug 23 23:12:24 2022] PUT /identity/v3/system/users/8be9dddfd57740f1b4d8b9ec5afc9bbf/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:24.329242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756b016-8030-401e-b813-060132f621cc None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.329541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756b016-8030-401e-b813-060132f621cc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.329821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756b016-8030-401e-b813-060132f621cc None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.332503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 161/306] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:24.332503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756b016-8030-401e-b813-060132f621cc None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.350610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.351228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.354201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.354201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] PATH_INFO: `/v3/groups` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.354201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.354201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ac640-ddf8-423e-ae85-97650a8c6421 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.451191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756b016-8030-401e-b813-060132f621cc None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.453086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 146/307] 10.222.0.91 () {60 vars in 1134 bytes} [Tue Aug 23 23:12:24 2022] POST /identity/v3/groups => generated 229 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:24.454529 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.455171 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.455458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.476615 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:24.478433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:24.507289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.508193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.508520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.508796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.528492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:24.534013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:24.534971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:24.535786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 162/308] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:24.541645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.571011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 147/309] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:24.579836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.661717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02ac24-296e-48ab-a438-804d8de1da4d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.703583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.704210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.704536 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.704818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.705513 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.705836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.707186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.717231 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 163/310] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.723046 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.752829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.829926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5921b-bfb8-4f7c-b1ea-bf4b956c2334 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.867264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.867916 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.868179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.868491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] PATH_INFO: `/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.882107 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] RBAC: Authorizing `identity:get_user(user_id=78813dbbac0e4bb2a6e70f0ffb6f9298)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.883559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.885857 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 148/311] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.891379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.917742 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.005336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.017987 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443b1c-6deb-4786-ac21-2571dd3df3de None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.034520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.058944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d10-6d68-4e94-9bca-8fcfc809437b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.064775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.065666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.066008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.066349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.067216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, user.id=78813dbbac0e4bb2a6e70f0ffb6f9298, scope.system=all) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:25.067591 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.069312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.076898 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 164/312] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/role_assignments?user.id=78813dbbac0e4bb2a6e70f0ffb6f9298&scope.system=all&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.113134 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.114028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.114477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.114899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.130374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:25.136621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:25.137601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:25.138411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 149/313] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:25.145843 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.262023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c7f6-f6cf-418c-bb41-d190cc8d4e11 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.299535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.300152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.300470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.300740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.301408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:25.301713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.303153 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.311901 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 165/314] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.317604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.430857 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e1a6-b0d4-4e1b-84d4-1a4b54e144ce None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.468459 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.469104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.469389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.469667 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] PATH_INFO: `/v3/users/a261fbd594694ea891eb14fc8070797c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.470820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] RBAC: Authorizing `identity:get_user(user_id=a261fbd594694ea891eb14fc8070797c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.472560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.474327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 150/315] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/users/a261fbd594694ea891eb14fc8070797c => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.481826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.507365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.605396 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03a29-e050-4771-b08e-865fffe4074b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.642473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.643093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.643374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.643706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.721680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.723075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.742687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.840569 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 166/316] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:25.843400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.865052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.948695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cfd3f-734a-4348-9da8-35539462505b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.984489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.984489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.984489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.984489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.985431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.986977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b6818-6100-4ae9-9f14-43118a75520c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.988910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 151/317] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.995509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.104461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846dc8b-46af-402c-bae3-00eca2d2b7a6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.122710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:26.141575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.142232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.142524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.142797 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.143519 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, scope.project.id=b5930ed2b2f1468589c98153a0425244, user.id=a261fbd594694ea891eb14fc8070797c) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.143827 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.145300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14dacd-daa8-4234-b95a-102231cee8d0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.152229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 167/318] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/role_assignments?user.id=a261fbd594694ea891eb14fc8070797c&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:26.682764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2380-f659-4597-93d0-931e0737fc5e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.683145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2380-f659-4597-93d0-931e0737fc5e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.683659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2380-f659-4597-93d0-931e0737fc5e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.685114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 152/319] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:26.690552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920fdc-c09a-4909-aa5a-3569bdd9004b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.690846 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920fdc-c09a-4909-aa5a-3569bdd9004b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.691128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920fdc-c09a-4909-aa5a-3569bdd9004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.711534 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-36920fdc-c09a-4909-aa5a-3569bdd9004b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:26.712853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-36920fdc-c09a-4909-aa5a-3569bdd9004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:26.787084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 168/320] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:26.873169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef57b-e15a-4978-ad3c-0fec36b5a99b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.873453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef57b-e15a-4978-ad3c-0fec36b5a99b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.873898 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef57b-e15a-4978-ad3c-0fec36b5a99b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.875226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 153/321] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:26.880771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.881066 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.881413 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.900412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:26.901664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:26.971457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 169/322] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:27.122098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef57b-e15a-4978-ad3c-0fec36b5a99b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.215807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.238556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef57b-e15a-4978-ad3c-0fec36b5a99b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.274610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.275244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.275530 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.275866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.286223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:27.291028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:27.291904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:27.292710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:27.296752 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 154/323] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:27.297961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.302370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.343686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.401574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f564-1ab7-4eab-b230-3df2dc4843eb None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.403098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5903f-73a6-4f86-b9bf-77e6c36ff30f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.434509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.435118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.435399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.435673 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.436336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:27.436669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.437389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.438007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.438103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9ab43-aa16-4e3f-b2c5-af573c6351b9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.438287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.438560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.439648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.441103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bb1f-eedf-491f-b2eb-c45a8996c142 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.442640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 155/324] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:27.448359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcea98-880d-422c-ade1-1c5096cdfc99 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.448359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcea98-880d-422c-ade1-1c5096cdfc99 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.448359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcea98-880d-422c-ade1-1c5096cdfc99 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.448359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 156/325] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:27.448683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 170/326] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:27.450860 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcea98-880d-422c-ade1-1c5096cdfc99 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.452386 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.452698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.452980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.462882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.471023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:27.474281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:27.539568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 171/327] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:27.540324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.562342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcea98-880d-422c-ade1-1c5096cdfc99 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.573331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.597244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.597862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.598147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.598425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] PATH_INFO: `/v3/groups` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.599053 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.601082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.648538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c0acf-5de1-4f05-8f53-ff2a1ebb9d57 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.682835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.683471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.683756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.684034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] PATH_INFO: `/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.685210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8be9dddfd57740f1b4d8b9ec5afc9bbf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.686662 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.694167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 157/328] 10.222.0.91 () {60 vars in 1134 bytes} [Tue Aug 23 23:12:27 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:27.694350 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 172/329] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/users/8be9dddfd57740f1b4d8b9ec5afc9bbf => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:27.694458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.783062 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.820079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ea06-0f07-49b0-a2e1-8e8dc4aac3f1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.861327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.861949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.862260 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.862540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.863274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] RBAC: Adding query filter params (role.id=686d6006762640dba07b0fb12570a686, user.id=8be9dddfd57740f1b4d8b9ec5afc9bbf, scope.system=all) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:27.863592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.866115 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.873907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.879109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 158/330] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/role_assignments?user.id=8be9dddfd57740f1b4d8b9ec5afc9bbf&scope.system=all&role.id=686d6006762640dba07b0fb12570a686 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:27.994982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.998057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0dec-787a-432b-9ab4-668832c206f3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.126727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.127308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.127594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.127871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.140501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:28.145291 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:28.150248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:28.151026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 173/331] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:28.154680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:28.276492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462146c-3968-4cdc-96d4-558bcda828d6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.305540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:28.312203 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.312874 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.313150 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.313447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.314307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:28.314618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:28.315992 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:28.329668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 159/332] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:28.335825 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:28.451477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13b3b-1577-4b6d-88f6-5e2082688ed7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.490219 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.491558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.491883 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.492162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] PATH_INFO: `/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.493365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] RBAC: Authorizing `identity:get_user(user_id=78813dbbac0e4bb2a6e70f0ffb6f9298)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:28.494829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad89e0-0138-4d13-8b09-e9c9c1bbd683 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:28.496603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 174/333] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:28 2022] GET /identity/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:28.502238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:28.627026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db695-2c50-464c-ad10-3a954e9a96bb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.666516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.667182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.667462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.667737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] PATH_INFO: `/v3/system/users/78813dbbac0e4bb2a6e70f0ffb6f9298/roles/ccaf3decf7434833abff4dd11aec3920` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.669221 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=78813dbbac0e4bb2a6e70f0ffb6f9298, role_id=ccaf3decf7434833abff4dd11aec3920)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:28.670610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c957-611f-4aad-a728-1847ca30ac03 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:28.775742 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 160/334] 10.222.0.91 () {58 vars in 1334 bytes} [Tue Aug 23 23:12:28 2022] PUT /identity/v3/system/users/78813dbbac0e4bb2a6e70f0ffb6f9298/roles/ccaf3decf7434833abff4dd11aec3920 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:30.315604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80094-03b3-452c-91eb-fffaeec08367 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.316105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80094-03b3-452c-91eb-fffaeec08367 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.316210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80094-03b3-452c-91eb-fffaeec08367 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.317830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 175/335] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:30.325370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c4b22-57eb-41c2-8c14-380c34f9e75f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.326172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c4b22-57eb-41c2-8c14-380c34f9e75f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.326662 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c4b22-57eb-41c2-8c14-380c34f9e75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.352907 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a91c4b22-57eb-41c2-8c14-380c34f9e75f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:30.354448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a91c4b22-57eb-41c2-8c14-380c34f9e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:30.431932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.463219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 161/336] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:30.618343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b692-7663-4c8c-b4da-3ed6f246d453 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.618982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b692-7663-4c8c-b4da-3ed6f246d453 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.619466 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11b692-7663-4c8c-b4da-3ed6f246d453 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.621115 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 176/337] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:30.626832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.627336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.627792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.653483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:30.655104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:30.738552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 162/338] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:30.988609 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11b692-7663-4c8c-b4da-3ed6f246d453 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.025899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.125972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11b692-7663-4c8c-b4da-3ed6f246d453 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.166304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.167235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.167699 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.168174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.182588 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:31.187694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:31.188595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:31.189423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:31.191721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 177/339] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:31.198451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.314793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68268ab0-475c-489a-bd68-d095cb3aa023 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.330237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.359666 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.360355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.360667 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.360945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.361631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:31.362006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.363387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.373424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 163/340] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:31.380101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.482268 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.496812 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.514647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b83c6-8e34-4f12-ac02-45e5dd255c07 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.580673 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.581614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.582105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.582586 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.753733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558161c7-7a61-4be8-8e9b-894aa0612a96 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.777668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.779589 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5825185-966f-4f9f-83fa-7e6b35eca216 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.830654 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.831360 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.831587 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.831866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.856981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:31.862623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:31.863486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:31.864285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 164/341] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:31.870555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.948987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.988815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.019516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 178/342] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:32.021139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10efd-bfa3-4013-9213-29ba6bf15292 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.021624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10efd-bfa3-4013-9213-29ba6bf15292 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.022123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10efd-bfa3-4013-9213-29ba6bf15292 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.028576 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 179/343] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:32.030753 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c692-21fb-4444-a239-c75495bb9883 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.031267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c692-21fb-4444-a239-c75495bb9883 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.031754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c692-21fb-4444-a239-c75495bb9883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.038393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c255e-a0ee-4574-9b50-632e9cc61d08 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.065482 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0472c692-21fb-4444-a239-c75495bb9883 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:32.067054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0472c692-21fb-4444-a239-c75495bb9883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:32.081476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.082315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.083128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.083570 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.086382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:32.086881 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.088800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.104271 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 165/344] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:32.105851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.175979 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 180/345] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:32.185508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c2f1-176a-4c60-87c2-a7912c7624c4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.185508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c2f1-176a-4c60-87c2-a7912c7624c4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.185508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c2f1-176a-4c60-87c2-a7912c7624c4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.185508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 181/346] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:32.185508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c2f1-176a-4c60-87c2-a7912c7624c4 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.252213 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.261940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb1a-409b-4ea2-af8c-10247ab43782 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.312252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.313642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.314385 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.314822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.316379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.318548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b0644-3161-4caa-b606-b62cabf4b014 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.321847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 166/347] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:32.323699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.324149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.324616 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.344771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c2f1-176a-4c60-87c2-a7912c7624c4 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.349354 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:32.351207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:32.367286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.392202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.393329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.394108 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.394960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.449721 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 167/348] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:32.450904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.492267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.494010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.591862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.604366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ccb75-9e13-438f-8058-58fbbdace521 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.616048 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 182/349] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:32.618184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.646847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.647929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.648535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.648891 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.649250 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.656956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.658822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.660875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 168/350] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:32.661989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.766634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b194-2802-42b3-a066-4147917bcf39 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.811545 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.812587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.813099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.813575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.816898 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fb22-4cdf-4012-9fb3-c2733175ead0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.829334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-65cc76a8-2cdd-4fe9-a0d4-6beb9b533ead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:32.834786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:32.836233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:32.837090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 183/351] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1c56-83de-48df-ac34-7a2ae05a5fdf None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1c56-83de-48df-ac34-7a2ae05a5fdf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1c56-83de-48df-ac34-7a2ae05a5fdf None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 184/352] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:32.842191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d1c56-83de-48df-ac34-7a2ae05a5fdf None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.868388 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.869448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.869935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.870430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.871820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.873581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.880304 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 169/353] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:32.881691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.920929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.958862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.989548 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d1c56-83de-48df-ac34-7a2ae05a5fdf None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.009352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386df8-b725-48f3-9aa4-e9d884d8b437 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.035884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.036538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.036826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.037257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.038212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=686d6006762640dba07b0fb12570a686, scope.project.id=03ee74f9b79d449eb98654a164f1ba41) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:33.038563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.040075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2751c8-c679-41f7-9c94-55622bbbbabd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.046838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 185/354] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=686d6006762640dba07b0fb12570a686 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.047975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.048268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.048580 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.066252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.066969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.067252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.067559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.068498 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:33.069215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.071665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.076095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:33.077583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:33.083251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 170/355] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.084555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.173044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 186/356] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:33.177648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.211658 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.262280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf90-0426-4efa-9289-85a6c55135d9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.306383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.324295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.325059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.325337 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.325746 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.328188 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.330336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.333280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 171/357] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.334153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.362487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b59a-ed08-4507-9c97-fb1c641bf025 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.410200 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.411162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.411162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.411544 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.427566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3ecddb88-8f44-4c22-a5c6-1238236ff43d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:33.434565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:33.435475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:33.436266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:33.436901 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 187/358] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:33.440477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b005f-1dbb-4fb1-88e0-eceedb2c0933 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.440477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b005f-1dbb-4fb1-88e0-eceedb2c0933 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.440477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b005f-1dbb-4fb1-88e0-eceedb2c0933 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.441205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 188/359] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:33.442036 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b005f-1dbb-4fb1-88e0-eceedb2c0933 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.472673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b5465-7e6b-4a10-9386-eaa66fc4683b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.531208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.531837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.532180 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.532492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.572320 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.594054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b005f-1dbb-4fb1-88e0-eceedb2c0933 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.634582 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.640924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.641597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.641884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.642171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.642391 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.642911 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=03ee74f9b79d449eb98654a164f1ba41) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:33.643230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.643802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0550-59f0-4900-a5fb-e7108b0737e4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.644946 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.653058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 189/360] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.653978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.775417 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 172/361] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:33.777175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.777716 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.778217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.793753 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1477b1-b092-4289-91e1-1f08a705967d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.806961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:33.808916 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:33.839615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.840655 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.841014 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.841366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.842447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:33.842846 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.845268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.858415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 190/362] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.859484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.886009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.914571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 173/363] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:33.915834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.949774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.032027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf951-fd26-4ef0-82d4-33ee688ab9ba None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.104296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.104977 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.105424 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.105714 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.126630 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c91a-09d7-49b4-b6d9-8c52b1c21924 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.132399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:34.142494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:34.143395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:34.144226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 191/364] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:34.144944 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.170006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.170769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.171061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.171342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.172509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.174138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.179827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 174/365] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.179827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.242401 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.294591 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cd664-dfdc-48c6-88c8-649b825e8f2d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.324213 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0dc87-eec8-46c2-ab50-090b309b3171 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.341107 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.342099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.342835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.343271 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.344149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.344671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.346510 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.347526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.358606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 175/366] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.359686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.376639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.377814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.378195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.378540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.486334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.487841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.502470 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222d09-2bcd-4228-8fd4-ca89103e829a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.526815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.550680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.551844 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.552278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.552854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.554190 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.556598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.559214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 176/367] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.560598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.616383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 192/368] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:34.617277 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.643719 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.689771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d86e2-31e3-45f2-85e7-c24023918e86 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.729827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.730724 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.731111 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.731486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.741334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731f9eb-3d6b-4469-968d-d9e559a191c4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.743061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:34.748494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:34.749584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:34.750576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:34.752479 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 177/369] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:34.758021 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.784940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.785866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.786300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.786727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] PATH_INFO: `/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.788041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] RBAC: Authorizing `identity:get_user(user_id=78813dbbac0e4bb2a6e70f0ffb6f9298)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.789752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.794780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 193/370] 10.222.0.91 () {56 vars in 1177 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/users/78813dbbac0e4bb2a6e70f0ffb6f9298 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.795864 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.812269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.876223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a57dab-c7a5-46cc-880c-933258af98e3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.895329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.912302 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3179-ae69-4f77-80c5-3c30c9dcdd5d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.915744 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.916887 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.916887 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.917217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.918123 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b5930ed2b2f1468589c98153a0425244) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.918535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.920235 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.926185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 178/371] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=686d6006762640dba07b0fb12570a686 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.927213 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.956957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.957890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.958426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.958851 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.960716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.962483 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.965515 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 194/372] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.966920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.052910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94523a5-332a-4d1f-8372-a768c2a07790 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.063782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.092766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.093465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.093848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.094196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.095010 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.095384 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.096079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815458c-d2ba-47cd-851a-148586a2f12f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.097104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.110731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 179/373] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.110731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.164149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.165247 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.165729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.166181 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.167269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] RBAC: Adding query filter params (role.id=ccaf3decf7434833abff4dd11aec3920, user.id=78813dbbac0e4bb2a6e70f0ffb6f9298, scope.system=all) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.167764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.169470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.188149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 195/374] 10.222.0.91 () {56 vars in 1308 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/role_assignments?user.id=78813dbbac0e4bb2a6e70f0ffb6f9298&scope.system=all&role.id=ccaf3decf7434833abff4dd11aec3920 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.195953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.228268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.269969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eddb7f-f8ce-4cf8-acd8-57a613807f42 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.381441 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.382165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.382468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.382797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.384052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.385825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.387492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 180/375] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.393389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.412773 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e738-3f14-42d0-a323-6d5a63907358 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.474073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.509876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.510790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.511059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.511336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.578475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324a3da-0c85-4a07-b9b2-f183b3aa2c20 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.641916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.643311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.646707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.647356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.647636 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.647910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.648666 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=b5930ed2b2f1468589c98153a0425244) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.648976 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.650463 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.660401 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 181/376] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:35.676660 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.796156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 196/377] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:35.801699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.947912 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a639b-8a98-43ba-a9d1-dd0f1cf1d762 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.949758 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.986628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.987274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.987560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.987835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] PATH_INFO: `/v3/projects/85959ef3f874453fbd26b056e71b4f53` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.989028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=85959ef3f874453fbd26b056e71b4f53)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.990478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab49f-471d-40c1-b23a-690f6e64d9d0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.993130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 182/378] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/projects/85959ef3f874453fbd26b056e71b4f53 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.998486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.007581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e2802-ca9d-45e0-a6f1-61403e03863c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.007994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e2802-ca9d-45e0-a6f1-61403e03863c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.008279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e2802-ca9d-45e0-a6f1-61403e03863c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.009913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 183/379] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:36.015595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.015888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.016170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.036253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:36.037553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:36.165050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 184/380] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:36.175720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae298aa4-c7aa-44c3-8351-67570de5839a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.199312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:36.238709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.239358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.239644 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.239922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] PATH_INFO: `/v3/groups/a994e45e66424d1892c434ba0bab81dd` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.251230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] RBAC: Authorizing `identity:get_group(group_id=a994e45e66424d1892c434ba0bab81dd)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:36.252724 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:36.254385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 197/381] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/groups/a994e45e66424d1892c434ba0bab81dd => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:36.261549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.387175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:36.390837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1518dd0-13e3-441d-894f-596ed9070901 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.435554 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.436173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.436492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.436755 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.437492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] RBAC: Adding query filter params (group.id=a994e45e66424d1892c434ba0bab81dd, role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=85959ef3f874453fbd26b056e71b4f53) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:36.437808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:36.439255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c559cb-fbf0-41b1-bc82-42381d8bf15c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:36.445991 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 185/382] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:36 2022] GET /identity/v3/role_assignments?group.id=a994e45e66424d1892c434ba0bab81dd&scope.project.id=85959ef3f874453fbd26b056e71b4f53&role.id=27562aa899b24a498ff1887ceca94449 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:36.781235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.918982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4088e8-957d-4c1f-b27c-3c7b27633938 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.959044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.959686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.960510 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.960792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.973503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:36.981994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efd34-e83a-4998-a69e-05d22d4c1a59 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.982901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efd34-e83a-4998-a69e-05d22d4c1a59 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.983375 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efd34-e83a-4998-a69e-05d22d4c1a59 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.984955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 186/383] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:36.985935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:36.986789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:36.987596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 198/384] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:36.990114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.990553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.991009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.992902 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.017697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:37.019203 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:37.058425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.131089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 187/385] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:37.159229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a3da0-daae-44a3-b4c8-fadc4df04215 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.197861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.198776 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.199237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.199684 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.200687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:37.201171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.202734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.220477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 199/386] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:37.224673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.363110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.369579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092d4be-1183-4c95-929b-ef9ff6552ed5 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.411044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.411693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.411977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.412255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.413452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.414893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.416567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 188/387] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:37.422247 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.572210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.576638 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6ec-43af-4d45-bb7b-06924ba7c83f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.618088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.618612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.618900 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.619180 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.620322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.621873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.623719 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 200/388] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:37.630066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.824063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c228-34d0-4850-933a-850d322ecbe1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.878445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.879120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.879412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.879691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/686d6006762640dba07b0fb12570a686` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.882298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, group_id=d4ae3f483ef44cb69d40e588a7978c42, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.884053 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d6925-4628-4237-95b8-7fda6a4109ad None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.937385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.956057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 189/389] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 23 23:12:37 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:38.034233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae46e5-bed6-4c6e-b35f-0c4f757b7b53 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.035317 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae46e5-bed6-4c6e-b35f-0c4f757b7b53 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.035812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae46e5-bed6-4c6e-b35f-0c4f757b7b53 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.037834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 190/390] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:38.044348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.049848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.049848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.068163 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:38.070555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:38.087113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782599-b0cf-4c63-859f-f692bc002e71 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.094988 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.154793 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.155443 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.155778 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.156057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.168267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:38.173190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:38.174139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:38.174927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 201/391] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:38.183119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.210346 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 191/392] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:38.229821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.340630 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9cad-f4b7-41fb-93f9-f6be9b42a5bb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.378038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.378651 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.378989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.379265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.379925 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:38.380224 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.381740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.391739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 202/393] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:38.397266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.540665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845ef2-b848-43c4-9997-5a8594fdb7bc None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.583237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.584253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.584787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.585273 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.589098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.590784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f84a-3b7e-4df5-ac53-0b16441d2558 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.592952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 192/394] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:38.598158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.694378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e1d4-ee05-4e0a-aac8-425fc526e5ce None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.695014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e1d4-ee05-4e0a-aac8-425fc526e5ce None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.695685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e1d4-ee05-4e0a-aac8-425fc526e5ce None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.701044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 193/395] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:38.702917 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.703410 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.703894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.716978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.731212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e36fa-e790-498b-9a57-2d97ed292805 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.734335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:38.735554 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:38.764815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.772138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.773518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.773799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.774117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.775735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.777199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.778971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 203/396] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:38.779566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.821256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 194/397] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:38.822099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.915836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ddd31-df40-4667-bb7d-2655d39b33b3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.949124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9984c4-3dae-4e04-8cbd-8a065e54ba44 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.955545 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.956183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.956512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.956795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.968909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:38.973693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:38.974599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:38.975425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 204/398] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:38.989010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.002849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.003899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.004364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.004838 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/bb2b6785ae6e468a941a62b4baff2705` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.007856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ee74f9b79d449eb98654a164f1ba41, group_id=d4ae3f483ef44cb69d40e588a7978c42, role_id=bb2b6785ae6e468a941a62b4baff2705)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.010225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.024080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.105735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 195/399] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 23 23:12:38 2022] PUT /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/bb2b6785ae6e468a941a62b4baff2705 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:39.130442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aafa9b-6be5-4229-8ece-82ad0008541a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.187772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.188408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.188895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.189174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.189854 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:39.190218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.191620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.204698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 205/400] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.211351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.250309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.353751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.382119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274710-4b50-4acd-b68d-1788cf1c1ec6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.433748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.434502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.434892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.435175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.436323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.437817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.439850 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 196/401] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.449490 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.455134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.496384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4bc-1852-4477-b67a-ee68ad85ef51 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.534478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.535109 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.535395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.535669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.546686 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2feea4e5-bc52-4de0-b6d9-915298b12b33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:39.551873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:39.552940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:39.553766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 206/402] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:39.554952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.555026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8193d-49f5-4a10-a05d-86e0c48cc580 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.555026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8193d-49f5-4a10-a05d-86e0c48cc580 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.555026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8193d-49f5-4a10-a05d-86e0c48cc580 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.560463 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 207/403] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:39.562116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.562402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.562677 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.586388 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:39.587983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:39.592130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca264-57bb-4f48-b4a8-3e21ab235e4e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.642522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.643072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.643352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.643622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.645014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.646527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.649379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 197/404] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.650211 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.679470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 208/405] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:39.680835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.761133 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.802371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aad302-adb8-48d7-ae00-3d3f7d22ea2f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.845483 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.846161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.846447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.846723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/686d6006762640dba07b0fb12570a686` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.848692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, group_id=d4ae3f483ef44cb69d40e588a7978c42, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.850506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.868482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed945b8-69da-4935-99ee-faa0df249cc4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.905861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.906473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.906758 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.907031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.907699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:39.908003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.909459 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.918972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 198/406] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.924553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.936399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.965802 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 209/407] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 23 23:12:39 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:40.044897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63aa4-195b-4507-8a00-28db981ff52b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.084294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.085308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.085685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.085965 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.087153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.090039 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.092080 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 199/408] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:40.097958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.155041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.246646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8c57-6e35-44cd-827b-14e8d3275cf2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.282513 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.291914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.292862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.293308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.293744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.295050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.301916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.303766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 210/409] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:40.307043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.308692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.330908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6454-6bf4-40b2-94a1-696fa3d1716f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.373397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.374460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.374960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.375464 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.387846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:40.393819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:40.394693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:40.395478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:40.399136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 200/410] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:40.405135 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.523954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb7cb-f3f0-495b-865b-89526e75753a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.563981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.564978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.565878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.566376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.567306 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:40.567842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.570264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.586706 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 201/411] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:40.591341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72141537-9c4c-4f50-a391-a470f1ef76fe None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.591460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.592583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.718754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cb87-5c7c-4423-b69a-50c701d81099 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.737215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.737965 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.738258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.738535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/bb2b6785ae6e468a941a62b4baff2705` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.753274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5930ed2b2f1468589c98153a0425244, group_id=d4ae3f483ef44cb69d40e588a7978c42, role_id=bb2b6785ae6e468a941a62b4baff2705)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.754764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b794d7a-304d-47d4-9bd2-38b85e5bc166 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.762208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.763118 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.763675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.764151 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] PATH_INFO: `/v3/groups/a994e45e66424d1892c434ba0bab81dd` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.765583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] RBAC: Authorizing `identity:get_group(group_id=a994e45e66424d1892c434ba0bab81dd)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.767277 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.769365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 202/412] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/groups/a994e45e66424d1892c434ba0bab81dd => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:40.775319 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.852333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.860472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 211/413] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 23 23:12:40 2022] PUT /identity/v3/projects/b5930ed2b2f1468589c98153a0425244/groups/d4ae3f483ef44cb69d40e588a7978c42/roles/bb2b6785ae6e468a941a62b4baff2705 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:40.907238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96e34-acab-44b7-b364-f61d8190baa9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.907845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba2c5-e048-48eb-ab5d-7356964931e8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.908142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba2c5-e048-48eb-ab5d-7356964931e8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.908427 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba2c5-e048-48eb-ab5d-7356964931e8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.909829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 212/414] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:40.923269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.923580 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.923834 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.948588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.949626 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.950114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.950610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] PATH_INFO: `/v3/projects/85959ef3f874453fbd26b056e71b4f53` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.952085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] RBAC: Authorizing `identity:get_project(project_id=85959ef3f874453fbd26b056e71b4f53)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.954016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.956229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 203/415] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/projects/85959ef3f874453fbd26b056e71b4f53 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:40.963890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.970060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:40.970871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.082458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895198d-b66a-4977-9a8a-028c201c2674 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.118168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.125636 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.126617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.127098 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.127584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] PATH_INFO: `/v3/projects/85959ef3f874453fbd26b056e71b4f53/groups/a994e45e66424d1892c434ba0bab81dd/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.129871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] RBAC: Authorizing `identity:create_grant(project_id=85959ef3f874453fbd26b056e71b4f53, group_id=a994e45e66424d1892c434ba0bab81dd, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.131556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.136262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 213/416] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:41.136720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.264011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 204/417] 10.222.0.91 () {58 vars in 1442 bytes} [Tue Aug 23 23:12:40 2022] PUT /identity/v3/projects/85959ef3f874453fbd26b056e71b4f53/groups/a994e45e66424d1892c434ba0bab81dd/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:12:41.475539 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.602029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a155cce-1929-48ff-8c75-a68a1d670127 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.638805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.639499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.639788 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.640063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.651238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d7793754-f0d9-4ee9-88c7-d06a2e1aaa2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:41.656063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:41.656962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:41.657763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 214/418] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:41.665308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.823331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f69d-f6e2-4106-9a0a-a600edbfb4fc None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.858177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53160-2ba6-4675-aa10-08de404d87ff None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.858823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53160-2ba6-4675-aa10-08de404d87ff None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.859307 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53160-2ba6-4675-aa10-08de404d87ff None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.861125 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 215/419] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:41.867032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.867718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.868253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.876383 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.877031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.877316 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.877592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.878260 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:41.878562 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.879991 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.890280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:41.891761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.895759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 205/420] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:41.907394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.960703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.994650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.009989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 216/421] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:42.042598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384787b-7490-410c-b037-b70c1198bdf4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.079650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.079650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.079650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.079650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.151970 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.153733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.220803 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.267478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 206/422] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:12:42.272908 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.418110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6a0fe-f25a-4f99-96b8-c1b99d00280d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.462823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.463461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.463746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.464017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.468802 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.470271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.472119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 217/423] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:42.474878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.477764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.580861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.630365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6561b2-f443-4f22-9bb9-7026e26e284d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.674120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.674974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.675359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.675740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.677271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.679941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.682142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 218/424] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:42.689410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.721285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53bab-1da6-41b9-b404-87c04180b5af None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.824709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0d79-36cd-4f80-a24f-1e0ea30be34d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.831556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.832220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.832524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.832798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.839568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.844808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-feb26731-7033-4364-bda7-49edb32e87ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:42.851788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:42.862579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 207/425] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:42.863361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbf3d-4de7-4009-8fcf-068a686d3f60 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.864079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbf3d-4de7-4009-8fcf-068a686d3f60 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.864079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbf3d-4de7-4009-8fcf-068a686d3f60 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.864079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 208/426] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:42.864079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bbf3d-4de7-4009-8fcf-068a686d3f60 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.873672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.874310 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.874687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.874961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.875689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=686d6006762640dba07b0fb12570a686, scope.project.id=03ee74f9b79d449eb98654a164f1ba41) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:42.876061 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.877672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b180-4a85-4c72-ab04-cbcc48f17839 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.884307 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 219/427] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=686d6006762640dba07b0fb12570a686 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:42.888870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.891425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.891727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.892002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.930294 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:42.931550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:43.017557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 220/428] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:43.040771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bbf3d-4de7-4009-8fcf-068a686d3f60 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.077546 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.078210 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.078497 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.078773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.079446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:43.079753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.081247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.090846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 209/429] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:43.097625 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.219174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cc9e-fdb2-4a01-8b5b-51a12715d0f2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.229990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.256208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.256938 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.257417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.257706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.330250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.331795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.415107 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.444045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 221/430] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:43.451263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.459522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.540287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.564780 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df3e5-cc5c-4549-a40e-34aea338990c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.582203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c75e1e-007d-43d5-8ea9-289c3b6dd006 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.612679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.613332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.613618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.613892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.623594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.624642 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.625150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.625622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] PATH_INFO: `/v3/projects/03ee74f9b79d449eb98654a164f1ba41` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.626269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:43.627192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] RBAC: Authorizing `identity:get_project(project_id=03ee74f9b79d449eb98654a164f1ba41)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.628878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13b77-7634-4f25-a9c9-25e4910b1a91 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.630740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 222/431] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/projects/03ee74f9b79d449eb98654a164f1ba41 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:43.632740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec838-d79f-4377-bd97-a6ba0cd0ebc4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.633249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec838-d79f-4377-bd97-a6ba0cd0ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:43.633379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:43.634229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:12:43.635014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:43.635639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec838-d79f-4377-bd97-a6ba0cd0ebc4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.635709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 210/432] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:43.637509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 223/433] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:43.641670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.649244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.649540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.649818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.674611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:43.674611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:43.774387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d131ae-e759-42f5-bce2-f39beb1335d2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.776683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 224/434] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:43.777674 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.781668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.830347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.831043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.831331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.831910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.833307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.834821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.837220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 211/435] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:43.842978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.852830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.889116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03935-70e6-4256-8675-4690dd253d5d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.928000 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.928401 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.928739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.929749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.930515 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:43.930820 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.932274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.941206 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 225/436] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:43.946766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.956110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211afb7-1bab-4c75-b810-b6d8bfa4f44e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.995526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.996142 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.996426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.996734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.997461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=03ee74f9b79d449eb98654a164f1ba41) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:43.997778 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.999225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f8a1a-8058-49f2-83a9-4f8a7985961e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.012782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 212/437] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=03ee74f9b79d449eb98654a164f1ba41&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.039422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.066214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641448-24e5-4676-918e-59cef3d72391 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.066527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641448-24e5-4676-918e-59cef3d72391 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.066781 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641448-24e5-4676-918e-59cef3d72391 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.068234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 213/438] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:44.077922 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.078253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.078532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.091083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d227da8-77f1-44c9-98d8-761088f535e0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.103136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:44.104303 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:44.134562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.135659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.136515 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.137007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.176722 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.182431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 214/439] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:44.183199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.225078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.227289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.311378 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.328068 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7b94-69ab-44bb-861c-1de82551b1bf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.356597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 226/440] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:44.361283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.381403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.382125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.382625 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.382842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.396348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:44.402496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:44.403425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:44.404226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 215/441] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:44.411262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.489456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.503095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22521e-f3c8-42ea-be99-d81b4712667b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.534526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783e355-1259-4392-bb98-cb4ad690279c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.551438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.552384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.554505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.554505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.556634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.558000 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.559815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 227/442] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:44.560663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.577582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.578184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.578465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.578737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.579402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:44.579707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.581104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.589725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 216/443] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.590520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.596986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.665600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e1c6-68a5-48bb-b183-92efae739864 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.692545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7706-2cfb-4cd6-af78-8f7e82d55843 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.699352 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.699985 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.700263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.700595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.710621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:44.714627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:44.715453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:44.716553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 228/444] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:44.717358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.732298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.732954 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.733241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.733572 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.734701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.736145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.738042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 217/445] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.738732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.814414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.820903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516f1c-c3e0-404f-bc78-76502ee23c72 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.838870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3141a-49a6-4ffa-ae46-8d73ccee7a9c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.856166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.856807 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.857093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.857363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.874227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.874826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.875142 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.875419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.876087 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:44.876392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.877808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.886381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 218/446] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.887178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.925006 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.926404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.940248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.989658 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429831a2-a807-40a3-9214-a7861c499ce3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.025784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.026396 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.026700 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.026920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.027075 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.028114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=686d6006762640dba07b0fb12570a686, scope.project.id=b5930ed2b2f1468589c98153a0425244) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:45.028605 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.030752 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.034730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 229/447] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:45.037585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.044158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 219/448] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=686d6006762640dba07b0fb12570a686 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:45.044158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.156980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4f7ad-df0f-4866-b656-35ae2d4c3ef6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.157531 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de5ed-5914-4169-9dab-c528c3ddfb87 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.176069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.196970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.197191 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.197604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.197707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.197884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.197988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.198145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] PATH_INFO: `/v3/projects/b5930ed2b2f1468589c98153a0425244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.198235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.199327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] RBAC: Authorizing `identity:get_project(project_id=b5930ed2b2f1468589c98153a0425244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.200892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.203082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 220/449] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/projects/b5930ed2b2f1468589c98153a0425244 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:45.208223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.286279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.294861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.296421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.344833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcebf-bda5-47f7-892b-d6f69593201f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.386811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.386811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.387102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.387178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] PATH_INFO: `/v3/groups/d4ae3f483ef44cb69d40e588a7978c42` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.388731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] RBAC: Authorizing `identity:get_group(group_id=d4ae3f483ef44cb69d40e588a7978c42)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.390519 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.392497 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 221/450] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/groups/d4ae3f483ef44cb69d40e588a7978c42 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:45.399581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.420768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 230/451] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:45.426594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.463275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.511576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389b2b-30e8-4bbf-a1b6-d170d6fb813c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.520938 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.528416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b815-a1ba-4b16-97fc-25d9d9a7e9fa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.545754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.546356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.546643 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.546920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.547653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] RBAC: Adding query filter params (group.id=d4ae3f483ef44cb69d40e588a7978c42, role.id=bb2b6785ae6e468a941a62b4baff2705, scope.project.id=b5930ed2b2f1468589c98153a0425244) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:45.547965 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.549528 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.555915 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 222/452] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/role_assignments?group.id=d4ae3f483ef44cb69d40e588a7978c42&scope.project.id=b5930ed2b2f1468589c98153a0425244&role.id=bb2b6785ae6e468a941a62b4baff2705 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:45.564327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.565203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.565601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.565990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] PATH_INFO: `/v3/projects/85959ef3f874453fbd26b056e71b4f53` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.567574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] RBAC: Authorizing `identity:get_project(project_id=85959ef3f874453fbd26b056e71b4f53)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.569224 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.571087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 231/453] 10.222.0.91 () {56 vars in 1186 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/projects/85959ef3f874453fbd26b056e71b4f53 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:45.577018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.686275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189fed0-051c-4e75-b0ab-971aadd53622 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.704739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.723640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.724282 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.724602 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.724882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] PATH_INFO: `/v3/groups/a994e45e66424d1892c434ba0bab81dd` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.726945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] RBAC: Authorizing `identity:get_group(group_id=a994e45e66424d1892c434ba0bab81dd)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.728581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16acd-8a8e-4bd2-9a90-2c2af5ba86b4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.730166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 223/454] 10.222.0.91 () {56 vars in 1180 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/groups/a994e45e66424d1892c434ba0bab81dd => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:45.736117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.838662 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c9a9-918f-4d50-9ed3-a95a0417ec1e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.873583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.874194 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.874474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.874748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.875468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] RBAC: Adding query filter params (group.id=a994e45e66424d1892c434ba0bab81dd, role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=85959ef3f874453fbd26b056e71b4f53) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:45.875784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.877244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e4bb-4033-40ac-9ed4-49148cf6eb9b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.883192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 232/455] 10.222.0.91 () {56 vars in 1376 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/role_assignments?group.id=a994e45e66424d1892c434ba0bab81dd&scope.project.id=85959ef3f874453fbd26b056e71b4f53&role.id=27562aa899b24a498ff1887ceca94449 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:48.408615 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8554-568f-496a-a1f4-f0e6a8fec87e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.409138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8554-568f-496a-a1f4-f0e6a8fec87e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.409255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8554-568f-496a-a1f4-f0e6a8fec87e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.410624 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 224/456] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:48.416971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2edad4-a1b7-4260-811e-7deba6ad8704 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.417970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2edad4-a1b7-4260-811e-7deba6ad8704 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.418670 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2edad4-a1b7-4260-811e-7deba6ad8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.439437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1b2edad4-a1b7-4260-811e-7deba6ad8704 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:48.441060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1b2edad4-a1b7-4260-811e-7deba6ad8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:48.464263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:48.518645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 233/457] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:48.575684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6885-e23e-4cbc-b483-423656066dcd None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.576004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6885-e23e-4cbc-b483-423656066dcd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.576236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6885-e23e-4cbc-b483-423656066dcd None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.578168 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 225/458] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:48.584240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b719af-9aa0-4549-9317-e339f78cb869 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.584596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b719af-9aa0-4549-9317-e339f78cb869 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.584822 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b719af-9aa0-4549-9317-e339f78cb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.605899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d6b719af-9aa0-4549-9317-e339f78cb869 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:48.607129 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d6b719af-9aa0-4549-9317-e339f78cb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:48.678437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 234/459] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:48.749740 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d7d2-f729-4124-b5ee-7c9c157f8f3f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.750059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d7d2-f729-4124-b5ee-7c9c157f8f3f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.750303 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d7d2-f729-4124-b5ee-7c9c157f8f3f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.751791 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 226/460] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:48.756918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.757762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.758041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.776612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:48.777747 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:48.847222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 235/461] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:48.874051 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d7d2-f729-4124-b5ee-7c9c157f8f3f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:48.988398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d7d2-f729-4124-b5ee-7c9c157f8f3f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.020466 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.026504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.027453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.027930 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.028397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.040152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.041966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.046152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-caa31404-6711-4b31-8b2e-f24a822a2ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:49.059432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.060381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:49.061265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:49.061265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.061265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:49.061265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 227/462] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:49.068495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3796-ac09-4fa7-93f3-0a8d9f4d1d4f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.068495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3796-ac09-4fa7-93f3-0a8d9f4d1d4f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.068495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3796-ac09-4fa7-93f3-0a8d9f4d1d4f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.068495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 228/463] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:49.068495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3796-ac09-4fa7-93f3-0a8d9f4d1d4f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.106794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.137269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1214f2-a252-45dd-9e95-a4ef8831b001 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.174892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3796-ac09-4fa7-93f3-0a8d9f4d1d4f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.176003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.176665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.176948 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.177972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.188158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.189715 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c63c4d44-535d-4353-a6f0-3b6657c44e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:49.206438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.207361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:49.208664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:49.208664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.208664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:49.208664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 236/464] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:49.209096 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.209384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.209658 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.211482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.212087 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.215426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.215426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.215426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.215426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.215718 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.227811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 229/465] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:49.228686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.230717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:49.232087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:49.294819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.300107 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 237/466] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:49.301037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.326192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.332175 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b32dc-8df8-44e3-bfd5-4290e01c86a0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.373141 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.373782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.374106 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.374445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.385313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.387028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:49.402777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.403739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:49.405003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:49.405003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.405003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:49.408821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59d5e-ec04-48c1-b003-25c818bf5613 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.408977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 230/467] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:49.409767 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.446201 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.446815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.447092 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.447369 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.448012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.448310 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.449717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.468498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 238/468] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:49.468498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.525981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cb2a-35a5-4bb4-bc52-b0a3e9540127 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.532967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.563935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.564504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.564797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.565074 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.565725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.567278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.577472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985406-c4d4-40db-a1d4-d61bf4385b1e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.611572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.612182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.612492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.612771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.613410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.613716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.615081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.627304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 239/469] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:49.628084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.692940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 231/470] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:49 2022] POST /identity/v3/users => generated 246 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:49.693781 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.707047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.732160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87786-a3b0-4fb8-af9a-96f6f9598a1c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.753667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.774320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.774960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.775249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.775526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.776187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.777783 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.815899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a1bb-0207-4f6d-babf-60a892779975 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.851682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.852345 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.852653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.852929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.859139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 240/471] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:49 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:49.860950 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.867484 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.869423 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:49.889567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.893274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:49.894359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:49.894359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.894359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:49.894359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 232/472] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:49.897236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.978275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.011747 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c9b8-3200-4fc4-85b8-0e60ab596cbd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.032873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97783b-2463-43c1-b239-d2f903c8870d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.071987 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.072612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.073715 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.073998 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.074647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.076117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ccb97-4dd1-4621-85fa-bf8f684bcda7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.076937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.077823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.078274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.078569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.079222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:50.079523 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.081000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.097846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 233/473] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:50.103393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.168602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 241/474] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:49 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:50.229065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e2f3-a864-4777-b6c3-23060e8be638 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.248903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.269583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.270435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.270720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.270998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.271657 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.273208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6813ec0-39db-4e89-8900-421d0171b372 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.345805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 234/475] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:12:50 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:52.039850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3238-36a3-4608-b707-47d601086133 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.040903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3238-36a3-4608-b707-47d601086133 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.041396 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3238-36a3-4608-b707-47d601086133 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.043173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 242/476] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:52.049051 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d916-8e9f-4aac-b6f8-91417f508d19 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.049876 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d916-8e9f-4aac-b6f8-91417f508d19 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.050346 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d916-8e9f-4aac-b6f8-91417f508d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.069427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e293d916-8e9f-4aac-b6f8-91417f508d19 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:52.071739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e293d916-8e9f-4aac-b6f8-91417f508d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:52.150241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 235/477] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:52.279550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1380-21e1-47ac-bc45-e96bcddfa22d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.279863 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1380-21e1-47ac-bc45-e96bcddfa22d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.280110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1380-21e1-47ac-bc45-e96bcddfa22d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.281721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 243/478] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:52.287152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965583e-f299-4c58-b9dd-234596ab8be0 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.287448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965583e-f299-4c58-b9dd-234596ab8be0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.287733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965583e-f299-4c58-b9dd-234596ab8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.308933 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-5965583e-f299-4c58-b9dd-234596ab8be0 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:52.310449 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5965583e-f299-4c58-b9dd-234596ab8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:52.389709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 236/479] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:52.485520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1380-21e1-47ac-bc45-e96bcddfa22d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.529017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.549871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42e47-07fe-44df-a73e-af06799089fa None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.550654 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42e47-07fe-44df-a73e-af06799089fa None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.551172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42e47-07fe-44df-a73e-af06799089fa None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.553094 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 237/480] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:52.559703 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.560283 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.560822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.581037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:52.584692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:52.610214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1380-21e1-47ac-bc45-e96bcddfa22d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.611592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.650336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.650720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.651002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.651280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.663478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:52.664584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 238/481] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0d5b85e1-115c-4a51-975c-cffb23b95be6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:52.669069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:52.669932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:52.670746 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 244/482] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:52.675741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.676996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c44507-c511-4e3e-a9b8-d4de4de7810e None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.677289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c44507-c511-4e3e-a9b8-d4de4de7810e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.677572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c44507-c511-4e3e-a9b8-d4de4de7810e None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.678824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 245/483] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:52.684734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.685024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.685308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.705040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:52.706264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:52.784898 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7193f-9bc3-4450-b6f8-58bb727fdce7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.789102 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 246/484] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:52.790404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.819417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.821926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.822554 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.822830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.823110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.823779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:52.824086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:52.825487 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:52.834370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 239/485] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:52.842782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.884803 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.911842 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc936d-e261-4568-a64c-4761b036b8f8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.943975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829256b-3e98-4930-87d9-9788f6d739bf None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.955066 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.955914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.956091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.956330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.969173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:52.975600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:52.977232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:52.978032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 247/486] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:52.984707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.993628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.993628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.993628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.993628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.001125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.003049 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:53.018869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.019955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:53.021045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:53.021045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.021045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:53.022049 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 240/487] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.022886 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.079363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.098629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703e23-8b42-46e9-bd69-81abc7d093f9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.107971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.131595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2c1a-24cd-4256-9db3-46899658bbaa None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.137639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.138242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.138596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.138874 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.139545 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.139845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.141258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.150007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 248/488] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:53.150814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.168792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.169428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.169711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.169990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.180166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:53.185447 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.189471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 241/489] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.190258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.252894 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78fd4-323f-4aaa-b959-2c31433b5955 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.287607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.288218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.289346 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.289681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.290319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.290633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.292009 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.296771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3cfc-cc91-48dc-91a8-495b01fc4dd6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.303878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 249/490] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:53.304790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.307345 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.335172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.336272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.336585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.336862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.339460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.348331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:53.353754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.354864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 242/491] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.355697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.406761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48d1d-e8f1-4f2f-bb49-ed65220b3a26 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.440311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.440964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.441248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.441522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.452469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.453927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.456581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26849143-f39b-406e-92d3-25a579124f90 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:53.469138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.470121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:53.470976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:53.470976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.470976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:53.470976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 250/492] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.471200 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.495482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.496089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.496375 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.496724 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.497389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.497697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.499078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.506852 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 243/493] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:53.508142 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.533075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.567004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.577528 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16b8f-82de-4803-a224-8996d223335d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.609856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0003d-b901-400f-92f8-c09f26ca3d17 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.612290 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.612951 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.613233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.613531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.621840 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.623304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:53.635476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.636416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:53.637623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 251/494] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.638204 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.648357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.649200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.649490 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.649772 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.650455 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.650767 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.652181 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.660263 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 244/495] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:53.661082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.736993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c8a6-b9ad-4aba-b9c2-51edee9f3918 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.751062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.760851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a26d4-7ad2-4e92-88c1-ecab6742fc87 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.770566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.771171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.771455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.771732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.772377 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.772747 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.774482 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.780969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.787780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 252/496] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:53.789030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.801488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.802128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.802415 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.802691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.814703 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.816163 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:53.831026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.831940 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:53.832822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:53.832822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.832822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:53.832822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 245/497] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.833035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.892331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd22b-7507-4369-a64a-fec8d33cb478 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.926258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.926867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.927147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.927425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.928140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.928467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.929916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.933209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908e2d-ef0c-4f27-b825-e8a76bdecc2b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.965721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 253/498] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:53.966298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.966546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.966933 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.967207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.967483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.979080 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.980586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:53.994440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.995333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:53.996188 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:53.996188 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:53.996188 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:53.996188 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 246/499] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.996411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.004276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.023635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.073228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6352a-66dd-4dd9-971c-bdeea82cc29b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.097311 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2877f5-2cab-45d6-9c02-6d59caf7e48e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.108186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.108848 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.109139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.109418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.116500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.118177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:54.129663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.130623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 254/500] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:54.131523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.136276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.137196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.137476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.137749 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.138418 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.138715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.140081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.151865 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 247/501] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.152684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.230967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.237300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.239702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcea4c-fad3-4392-84a5-140af83463b5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.252553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec0c4-2f57-4335-a869-6931b7f958ec None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.274605 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.275211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.275494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.275773 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.286328 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.286926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.287202 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.287472 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.288103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.288468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.289944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.300851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 248/502] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.301637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.343765 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.345317 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.408930 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eba82-b1ab-4f39-a852-cdc72901b6fa None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.441646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.442997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.443711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.444009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.444287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.445599 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.445997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.447479 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.451587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 255/503] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:54.452413 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.485327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 249/504] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.486237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.492169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.552710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bd502-6699-45c3-9231-19f76173fe02 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.590116 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab28-1755-4846-9d31-2f94f4ad3477 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.591804 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.592456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.592736 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.593005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.599995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.601634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:54.613043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.614064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:54.615011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 256/505] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:54.615612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.628227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.628895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.629179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.629453 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.638193 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.639685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:54.653156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.654238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 250/506] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:54.656017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.672892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.719526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.720586 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24412ef-50f3-4b7a-a715-dcb12ee7d7b6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.754516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.755150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.755437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.755716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.760311 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790a09-5d6f-450d-8934-b6608a9b6777 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.766970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.768473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:54.783314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.784324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:54.789974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:54.789974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.789974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:54.789974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 257/507] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:54.789974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.794763 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.795365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.795645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.795919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.862956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.864408 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.887270 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9000a5-c80d-4da1-aaba-62d6a95c36c4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.889561 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.920803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.921903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.922375 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.922707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.923824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.924089 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.924292 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.925616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.944041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 258/508] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.945698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.970380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 251/509] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:54.971082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.049622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdade1d9-aec5-42cb-9fce-2c155e9f1b66 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.070674 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0c1a-aa58-4d61-b638-b6af00105607 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.083754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.084370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.084680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.084959 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.085707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.086015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.087464 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.104252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.104893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.105062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 259/510] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.105178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.105436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.105822 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.106070 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.106375 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.107745 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.119585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 252/511] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.120380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.129103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.145564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.206499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960d26-7f17-4386-af50-1fd83083231a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.222812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1afdb0-56f6-468b-ada6-9724450ef38c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.243942 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.244587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.244880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.245162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.259144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.259771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.260054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.260329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.270803 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.272266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:55.286586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:55.287604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:55.289109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:55.289109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.289109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:55.289109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 253/512] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:55.289404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.317602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.319068 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.338993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.362938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.389195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d301155-b3fd-4562-8778-8c17caa0f990 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.419233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 260/513] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:55.419888 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.422822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.423427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.423956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.424231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.490127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.491541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.521240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e373-a116-4dfe-b107-bf3b75c23d4e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.540696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.554789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.555373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.555652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.555966 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.562924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.564382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.566165 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:55.576669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:55.577587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:55.578439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 261/514] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:55.578939 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.593172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 254/515] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:55.594004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.690306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e68b-8cc6-4789-97fb-0ecf52330451 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.698771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916059bf-98b5-4a38-94a7-b0315408a38c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.724480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.725089 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.725373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.725652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.726560 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.727075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.728487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.733497 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.734161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.734436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.734714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.740428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 262/516] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.741190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.749015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.750581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:55.766112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:55.767008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:55.767862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:55.767862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.767862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:55.767862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 255/517] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:55.768073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.787921 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.795431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.845957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab82ab1-7d77-4731-97d5-998d20a2d27d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.867536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb40ae-68c0-43ab-b417-dfb5f2405e59 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.880409 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.881032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.881312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.881577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.882262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.882559 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.884163 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.901521 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 263/518] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.901912 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.902371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.902541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.902870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.903172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.913307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.915473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:55.930426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:55.931356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:55.932205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:55.932205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:55.932205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:55.932205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 256/519] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:55.932424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.004661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.007665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666858-2cf3-4cd4-8ea7-2abfb65ef686 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.010372 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.031105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d6dd-dee9-463f-88cb-7c96daca8890 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.041780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.044323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.044323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.044323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.049741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.051272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:56.062940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:56.063835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:56.064772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 264/520] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:56.065233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.067357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.067963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.068244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.068770 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.069426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.069802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.071279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.082938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 257/521] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.083729 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.174993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bae1-01d6-4a86-8d31-a8e3726ed70e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.183950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792586-a285-46de-9a88-5f4cfe221ed0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.209057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.209786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.210139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.211027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.211796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=a3307a556ec14aec850542633862b57a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.212189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.213692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.218288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.218633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.218911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.219187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.219277 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 265/522] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/role_assignments?user.id=a3307a556ec14aec850542633862b57a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.219830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.220032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.220122 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.221594 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.233364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.243564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 258/523] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.243564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.257282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.342979 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755e48-ecfb-4cc0-a6eb-2a87072a0521 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.358271 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8f99-b70f-49b6-b284-74ab0a5efb94 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.381884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.382876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.383156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.383436 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.384191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.384529 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.385997 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.395992 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.396687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.397024 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.398658 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.400001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 266/524] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.401128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.407522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.409404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:56.422031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:56.422903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.423843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:56.431077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 259/525] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:56.431077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.491335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.494565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.512359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52e4b-fd7c-4039-a38b-dd108acf72e9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.543069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9888a-672b-49df-a6b4-798f421d62da None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.546781 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.547420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.547729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.548034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.556540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.558042 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:56.569281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:56.570217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:56.571051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:56.575168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 267/526] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:56.576023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.581127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.582196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.582637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.583062 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.583945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=71640ebebcef490e9f3425f7559e3b57) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.584417 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.585950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.591782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 260/527] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/role_assignments?user.id=71640ebebcef490e9f3425f7559e3b57&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.592622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.709575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a44a8-94b2-49ad-a31d-0c969a83963f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.731484 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213acf-7f64-4f5d-bcfa-17bafac22419 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.752000 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.753069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.753554 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.754023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.754962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.755494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.757205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.770395 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.770932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.771217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.771491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.772187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.772543 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.773467 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 268/528] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.774935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.776388 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.780745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.785140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.797950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 261/529] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.804017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.913797 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23783-2000-443e-8df4-ae2415753940 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.935304 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807fc4-3721-4850-853a-0455165d42fd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.960366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.961382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.961873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.962343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.963748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=d0fb7270ef9444348b30a65938ede20a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.964532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.966675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0b96-098e-454b-bb52-0a796a7bb50e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.980494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.980494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.980494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.980494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.980895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=ab7ee24711494e088ca175321680612f) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.980895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.981509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 269/530] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/role_assignments?user.id=d0fb7270ef9444348b30a65938ede20a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:56.982888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7d0f-5bb2-4cd3-9588-1430064db113 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.988339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 262/531] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/role_assignments?user.id=ab7ee24711494e088ca175321680612f&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:58.479427 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3859e-2c0f-46e0-9d0b-0e535edc1f58 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.479929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3859e-2c0f-46e0-9d0b-0e535edc1f58 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.479929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3859e-2c0f-46e0-9d0b-0e535edc1f58 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.481543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 270/532] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:58.486889 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076aced-ce28-4d58-98f1-24dc4a2424ac None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.487357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076aced-ce28-4d58-98f1-24dc4a2424ac None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.487437 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076aced-ce28-4d58-98f1-24dc4a2424ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.506996 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0076aced-ce28-4d58-98f1-24dc4a2424ac None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:58.509309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0076aced-ce28-4d58-98f1-24dc4a2424ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:58.555919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.582553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 263/533] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:58.859604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ad0e-7217-47aa-a7e3-5ca674850553 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.859793 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ad0e-7217-47aa-a7e3-5ca674850553 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.860077 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ad0e-7217-47aa-a7e3-5ca674850553 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.861728 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 271/534] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:58.870542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.870968 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.871345 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.890881 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:58.892086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:58.917422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ad0e-7217-47aa-a7e3-5ca674850553 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.980531 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 264/535] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:59.010832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.047991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ad0e-7217-47aa-a7e3-5ca674850553 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.086075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.086751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.087249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.087528 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.101958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8563fef5-7c16-4c6b-ad66-df47e5701844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:59.109179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.110229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:59.111045 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 272/536] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:59.116347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.230966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb415-0826-4783-aeba-da2f2e23e821 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.239274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.253817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc767e-9199-438f-8a43-8669b4e6f122 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.254122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc767e-9199-438f-8a43-8669b4e6f122 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.254370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc767e-9199-438f-8a43-8669b4e6f122 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.257962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 273/537] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:59.262333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe633-ee06-4cd7-8099-b03c8bacbbc1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.262618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe633-ee06-4cd7-8099-b03c8bacbbc1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.263230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe633-ee06-4cd7-8099-b03c8bacbbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.268404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.269056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.269339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.269680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.270408 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:59.270720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.272083 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cd3f2-1cc1-4a85-8cfd-bfe3bb4d480d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.281699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 265/538] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:59.282923 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee17d-c47d-4706-b4af-f49d07a93a80 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.283212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee17d-c47d-4706-b4af-f49d07a93a80 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.283491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee17d-c47d-4706-b4af-f49d07a93a80 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.284977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 266/539] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:59.286397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ff6fe633-ee06-4cd7-8099-b03c8bacbbc1 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:59.286688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafee17d-c47d-4706-b4af-f49d07a93a80 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.287897 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ff6fe633-ee06-4cd7-8099-b03c8bacbbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:59.362859 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 274/540] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:59.364067 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.364357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.364661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.387451 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:59.390049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:59.394276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafee17d-c47d-4706-b4af-f49d07a93a80 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.434494 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.435216 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.435499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.435776 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.446648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.449138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.449241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.466564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 275/541] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:59.467216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:59.471125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.478132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:59.479026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:59.479026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:59.479026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:59.479026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 267/542] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:59.481588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.510622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.606093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a497f-0c59-461a-8113-a372d892d933 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.611880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d741a-e5ca-401f-ad8d-1f3e146278d0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.652095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.653255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.653762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.654244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.655132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.655798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.656084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.656358 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.657055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:59.657492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.659161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.670654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:59.676301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.677541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:59.678526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:12:59.679267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 268/543] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:59.679267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.682021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 276/544] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:59.687823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.738814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.768946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.791257 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4c1d-51a9-4f5c-b26b-842338a2febb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.798116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16214c-0374-4366-9b22-31b954665a29 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.833331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.833940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.834223 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.834496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.835155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:59.835486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.835655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.836179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.836482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.836765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.837081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.843779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.845021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 277/545] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:59.845234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.845818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:59.860671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.861635 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:12:59.862537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 269/546] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:59.863085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.949543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52d60-f5d1-4284-9608-f20af6572b02 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.959438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.962961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad5a97-a49d-4019-bc4b-e584b990bf1e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.983968 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.984627 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.984910 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.985184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.996307 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:59.996584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.997210 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.997495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.997773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:00.000962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.001995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:00.002856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 278/547] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.003520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.010379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.015053 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:00.019875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.020764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:00.021566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 270/548] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.022244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.108425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492990-d4de-45c8-9017-2bad1cf2163f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.122276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e0ec0-6c94-4051-a017-91b8bc72f345 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.142086 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.142708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.142990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.143264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.154509 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.159717 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.159814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.159814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.159814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.159814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.160095 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.160095 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.160223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:00.170884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.172349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:00.173419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:00.173419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.173419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:00.173419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 279/549] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.173419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.182226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 271/550] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.183072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.202053 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.245267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.281246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374033d-bc18-4b3e-b45b-716973ccfc71 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.289700 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa301e-c4ff-40d3-b4e2-1cf21a7c8b34 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.314313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.314913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.315202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.315475 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.316135 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.316460 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.317842 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.323455 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.324063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.324343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.324656 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.325371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.325680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.326351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 280/551] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.327035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.327135 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.336876 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 272/552] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.337681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.417038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.432469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0c1a-9825-410c-a5a0-3926f5cfac88 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.438979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d08b1-9bcb-42b7-9624-04cc5ce521bc None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.459067 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.467966 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.468634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.468921 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.469199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.469838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.470149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.471533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.473880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.474513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.474794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.475069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.484075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 281/553] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.484975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.488878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.490445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:00.509228 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.510427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:00.515509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:00.515509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.515509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:00.515509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 273/554] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.515509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.594557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8d50-0866-4347-9316-9aee931d13f0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.615853 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2201a-d269-4c24-aa6e-473597a9bbe8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.628156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.628821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.629105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.629386 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.642036 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.643561 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.646394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.651461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.652199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.652504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.656829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:00.658691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.659749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:00.661198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:00.661198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.661198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:00.661198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 282/555] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.661198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.665431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.666906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:00.681820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.682830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:00.683705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:00.683705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:00.683705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:00.683705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 274/556] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.684131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.709302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.768620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d09f9-5ae7-4069-8b01-090e7e51f01f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.782611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab8155-9c72-4f0f-ab81-fca1c3f6b052 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.802082 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.802704 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.802985 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.803259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.815411 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.816919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.817532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.818135 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.818424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.818703 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.819374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.819683 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.821777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:00.828512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:00.829632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 283/557] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:00.831051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.839769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 275/558] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.839769 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.891626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.921131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.935875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83fc37-0458-473b-8978-0e964a2c051f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.936371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350421-5855-46d0-a873-88e0d139abfb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.970011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.970554 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.970843 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.970935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.971123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.971456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.971741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.971829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.972018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.972107 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.972686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.972992 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.973497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.974344 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.986539 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 276/559] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.991525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 284/560] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.991670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.991815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.093517 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba7470-fe50-4586-993a-f829c5ce9822 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.094068 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37e9-50b5-44a9-9600-754893f4ddff None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.110578 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.127108 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.127717 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.128002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.128282 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.128468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.129048 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:01.129152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.129362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.129457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.129632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.130795 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.136945 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.138637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.149281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 277/561] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:01.149921 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:01.152333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:01.153248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:01.154159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:01.154686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.154759 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 285/562] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:01.155919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.257517 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053878e-6dea-4660-bd36-487e360e4be4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.263926 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7f6be-4b4a-4fca-8a16-5baf9d2d7c94 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.292386 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.293050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.293340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.293623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.298359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.298984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.299266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.299539 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.301304 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.302738 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.308394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.309866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:01.314402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:01.315569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 278/563] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:01.317026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:01.322059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:01.323078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:01.324072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 286/564] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:01.324703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.358774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.384400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.423325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b6774-a1e3-46f3-9ab0-e46afc7a8101 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.423527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857afeb-b81f-47fa-bf03-4d9797f2f2fc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.457025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.457237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.457631 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.457753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.457913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.458038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.458187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.458316 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.458871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:01.459179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.461189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.470086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.471596 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.472936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 287/565] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:01.473733 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:01.486726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:01.487771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:01.488756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:01.488756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:01.488756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:01.488756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 279/566] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:01.488756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.576515 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.582446 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954033-36fa-4951-8900-6ca41b1b9477 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.589112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c78d8-796f-420d-a81f-cab6154ca181 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.602701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.616134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.617286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.617578 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.617909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.618616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:01.618922 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.620363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.623457 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.624060 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.624347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.624655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.625385 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:01.625698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.627151 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.639232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 288/567] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:01.640029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.651031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 280/568] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:01.651031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.743266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2362b-b386-4356-9f74-d1993dca771b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.748931 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05596c31-813d-4d96-9f3e-666227c56f92 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.779516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.780242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.780590 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.780875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/a3307a556ec14aec850542633862b57a/roles/94850633c10a4dfa91a4c24d920f7580` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.783827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.784449 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.784760 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.785043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.785686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:01.785990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.787405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.796287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=a3307a556ec14aec850542633862b57a, role_id=94850633c10a4dfa91a4c24d920f7580)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.797785 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.800033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 281/569] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:01.801071 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.831871 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.865562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 289/570] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:13:01 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/a3307a556ec14aec850542633862b57a/roles/94850633c10a4dfa91a4c24d920f7580 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:01.867786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:01.878402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:01.912403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89692ce5-54df-4b85-b0bd-417850dfdc62 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.954020 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:01.954678 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:01.954964 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:01.955241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:01.967695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:01.969553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:01.986439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:01.993659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:01.994627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:01.994627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:01.994627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:01.994800 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748a91-0d1f-4420-adfa-9826206f3a37 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:01.994875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 282/571] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:01.994875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.033990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.034646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.034933 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.035232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.047439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.048969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:02.069497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:02.072334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:02.073265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:02.073265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:02.073265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:02.073265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 290/572] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:02.073265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.101722 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.118913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e330d3-5e18-418c-9d8a-b5ca794ebf54 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.139703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.157018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.157657 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.157941 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.158215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.166086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.167540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:02.180400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:02.181433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:02.182352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 283/573] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:02.183360 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.193330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e799bb-2f4f-42fc-8f59-c677a485bae8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.235656 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.236767 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.237056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.237331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.238425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:02.238898 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.240282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.252539 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 291/574] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:02.253374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.307357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e68b-08d3-463b-b84a-c2eccab1ab60 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.343318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.343917 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.344196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.344506 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.345143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:02.345448 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.346807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.363185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 284/575] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:02.363185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.365956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.368268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5396b-54fb-4a57-a391-c4a1be36ec7a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.386455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.404971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.405909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.406177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.406451 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.407140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:02.407447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.408921 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.427160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 292/576] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:02.427160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.475549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9bf-3e76-4d6b-9a58-963fd363fdcd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.511747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.512669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.512955 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.513242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.519982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.521445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:02.533540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:02.534623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 285/577] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:02.535525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.545911 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821b76-af6b-4032-a04b-183a2301c109 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.580081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.580745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.581026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.581301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.588469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.589948 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:02.600775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:02.602225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:02.603118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 293/578] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:02.603599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.607465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.644884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.648837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54da34-e452-44ab-abf0-f549e16db309 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.686313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.686975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.687261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.687541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/71640ebebcef490e9f3425f7559e3b57/roles/94850633c10a4dfa91a4c24d920f7580` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.703200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=71640ebebcef490e9f3425f7559e3b57, role_id=94850633c10a4dfa91a4c24d920f7580)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.704691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.714037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aa5d0-5064-4ddd-8d96-f5c05eabb144 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.747852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.748474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.748754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.749030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.749708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:02.750011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.751434 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.763577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 294/579] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:02.764350 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.810161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 286/580] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:13:02 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/71640ebebcef490e9f3425f7559e3b57/roles/94850633c10a4dfa91a4c24d920f7580 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:02.811130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.876974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:02.885552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28862b5-6dc9-47f4-9bbf-9dfca84b99ca None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.932033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:02.932766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.933189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.933470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.934177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:02.934661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:02.936518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:02.953983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 295/581] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:02.959429 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960966b-1dea-4411-a0bc-9cbcba08756e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:02.959770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:02.980173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.013501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.014252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.014536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.014814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/d0fb7270ef9444348b30a65938ede20a/roles/94850633c10a4dfa91a4c24d920f7580` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.037790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=d0fb7270ef9444348b30a65938ede20a, role_id=94850633c10a4dfa91a4c24d920f7580)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.040329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f4aad-ad03-465a-af67-08e387532f36 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.096385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41f77-12cf-48bb-a300-761a61814f03 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.130187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 287/582] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:13:02 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/d0fb7270ef9444348b30a65938ede20a/roles/94850633c10a4dfa91a4c24d920f7580 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:03.137602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.138337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.143843 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.143843 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/ab7ee24711494e088ca175321680612f/roles/94850633c10a4dfa91a4c24d920f7580` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.157064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=ab7ee24711494e088ca175321680612f, role_id=94850633c10a4dfa91a4c24d920f7580)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.158557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b73e-a181-4037-9ee8-508372d407c1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.261117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 296/583] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:13:02 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/ab7ee24711494e088ca175321680612f/roles/94850633c10a4dfa91a4c24d920f7580 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:04.151542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0932a-6976-4c86-9863-51c305c3a163 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:04.152115 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0932a-6976-4c86-9863-51c305c3a163 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:04.152115 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0932a-6976-4c86-9863-51c305c3a163 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:04.153829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 288/584] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:04.159186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:04.159603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:04.159748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:04.173115 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:04.180613 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:04.181883 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:04.257507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 297/585] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:04.622805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0932a-6976-4c86-9863-51c305c3a163 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:04.706956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0932a-6976-4c86-9863-51c305c3a163 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:04.742673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:04.743380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:04.743675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:04.743945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:04.754485 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:04.759866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:04.760828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:04.761688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:04.766009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 289/586] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:04.767434 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:04.873450 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dbdc8-4916-47d6-9941-090b89a63a7a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:04.909172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:04.909791 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:04.910071 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:04.910346 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:04.911021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:04.911327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:04.912791 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ab9e-b937-4018-9fc4-8daaa7c60872 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:04.916223 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:04.928205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 298/587] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:04.933123 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:04.962318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.045614 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bfee-02c2-47e1-b641-8de3942ee0ae None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.082430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.083062 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.083347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.083626 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.094858 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:05.096308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:05.101199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb549a-4868-45ff-84f8-0c3791564660 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.101526 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb549a-4868-45ff-84f8-0c3791564660 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.101806 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb549a-4868-45ff-84f8-0c3791564660 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.103614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 299/588] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:05.110283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.110569 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.110850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:05.112247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:05.113224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:05.114172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:05.114172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:05.114172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:05.114172 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 290/589] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:05.119471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.133852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:05.135329 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:05.202545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.216462 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 300/590] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:13:05.245595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d4d3-0a91-4f6f-a3f1-39ffeb6a5380 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.282432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.283038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.283319 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.283594 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.284236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:05.284575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:05.285990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:05.299117 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 291/591] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:05.307675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.425410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde21af-d73d-437e-9896-84582dd2e1bf None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.454255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.463079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.463715 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.463999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.464274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.471871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:05.473432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0f0d7139-e07d-4989-88a3-507e623cbc20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:05.486074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:05.488697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:05.489701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 301/592] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:05.496100 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.541246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464fbb4-ad3d-4e64-be5a-7f3540cc1b07 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.541627 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464fbb4-ad3d-4e64-be5a-7f3540cc1b07 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.541811 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464fbb4-ad3d-4e64-be5a-7f3540cc1b07 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.543390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 302/593] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:13:05.551066 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4eb1f-c31c-427f-8f32-359dd399d935 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.551353 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4eb1f-c31c-427f-8f32-359dd399d935 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.551614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4eb1f-c31c-427f-8f32-359dd399d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.572091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e3d4eb1f-c31c-427f-8f32-359dd399d935 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:05.573335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e3d4eb1f-c31c-427f-8f32-359dd399d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:05.608947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf14-70dd-42f7-8083-03a0d6de4674 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.643934 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 303/594] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:13:05.644334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.644972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.645252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.645355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43246c-799b-4f20-956d-8be6d9076941 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.645527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.645643 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43246c-799b-4f20-956d-8be6d9076941 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.646001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43246c-799b-4f20-956d-8be6d9076941 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.646249 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:05.646549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:05.648499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 304/595] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:05.648499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43246c-799b-4f20-956d-8be6d9076941 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.648707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5510-cec8-48e5-8383-5c83580eab8b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:05.652868 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.669206 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 292/596] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:05.670509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.670863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.671249 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.696982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:05.696982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:05.764362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 293/597] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:05.765695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.791245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43246c-799b-4f20-956d-8be6d9076941 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.816821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.835829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.836803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.837276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.837910 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.849229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:05.856279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:05.857295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:05.858143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:05.861051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 305/598] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:05.866186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:05.890136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c72e-7cbb-43c5-b3be-383580b00189 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:05.916357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.928295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:05.928946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.929232 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.933883 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.983725 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3f29-9403-41e7-af15-8d724a6d7747 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.001552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.003022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.018374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.019126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.019473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.019821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.020607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:06.021007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.022698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.032936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 306/599] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:06.038331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.080646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.107788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 294/600] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:06.108542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.133368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.144013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3203-44f9-4530-ab64-8d85ffb9bcd9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.180205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.180868 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.181144 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.181416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.192065 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:06.198470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.199426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 307/601] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.200289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.214498 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82648531-380f-43e0-904e-843fc85b64e1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.249924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.250474 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.250757 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.251032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.262006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.263702 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:06.277957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.279041 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:06.280397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:06.280397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.280397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:06.280397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 295/602] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.280397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.301342 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.304324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5af81-49a8-44b7-9efc-26045628589f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.340198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.340857 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.341133 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.341407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.351744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:06.356823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.357808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:06.358675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 308/603] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.359364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.359438 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.383539 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c5e5-130c-4d7b-86e9-ecdad6d00e5c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.418184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.418809 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.419083 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.419357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.429486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.431519 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:06.445647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.446628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:06.447508 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:06.447508 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.447508 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:06.447508 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 296/604] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.447759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.463842 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2b1e-c99b-4c1c-be96-f8a051749b27 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.499210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.499815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.500157 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.500381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.501103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:06.501411 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.502913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.511116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 309/605] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.511984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.536063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.553823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db449-35e9-4bf6-9be3-010a23ddac2f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.581404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.589007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.589609 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.589894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.590170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.590814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:06.591119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.592506 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.604737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 297/606] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.605767 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.613021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97635-8101-40d0-884e-1498ce8d8f1e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.647535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.648661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.649054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.649563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.650259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:06.650561 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.651934 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.659706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 310/607] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.660505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.711192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8a418-3321-4f1d-9a90-34de1e2ca2a1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.744896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.745492 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.745772 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.746050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.746471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.746685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:06.746990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.748347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.762430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 298/608] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.762430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.762891 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413e1a5-d772-4953-8049-56bb38fc733a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.798093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.798811 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.799171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.799520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.810218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.810363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.811853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:06.827208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.828229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:06.829246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:06.829246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:06.829246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:06.829246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 311/609] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.829565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.865198 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e849-a0fe-40c2-ac73-811a3edeeb11 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.899880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.900547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.900832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.901110 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.908527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.909982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:06.921846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:06.922952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 299/610] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:06.924112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.938793 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f951-680e-42b5-9d55-db69650d7366 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.974774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.975742 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.976027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.976399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.979672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.987732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.989212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:07.003126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:07.004171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:07.005501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:07.005501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:07.005501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:07.005501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 312/611] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:07.005501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.030997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f899c0-ac7c-4636-9518-8d1126902648 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.040918 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.065920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.066547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.066831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.067107 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.074366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.076720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:07.088323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:07.089237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:07.090121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 300/612] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:07.090601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.112809 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adebf28-8fee-4caf-ae3f-b9e04a45a152 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.147603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.148274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.148664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.149001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.149701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.150005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.151362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.162826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 313/613] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.163669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.193131 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdced10-826b-4b67-babd-ece6a22a2b65 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.218175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.230371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.231240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.231525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.231810 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.232563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.232873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.234306 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.255511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 301/614] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.259438 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.281650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ace5-3bc5-4d52-91fe-e2c2d66a3de8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.297633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.327338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.327966 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.328254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.328629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.329226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.329718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.330896 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.343229 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 314/615] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.344240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.375754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26b915-ba86-4841-bd52-62baf16221c2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.412385 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.413123 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.413552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.414528 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.415261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.415571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.417056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.428993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 302/616] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.430030 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.455583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c1f7-110a-4196-bb18-d9198d185294 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.466100 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.496538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.498004 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.498150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.498481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.510243 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.512000 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:07.525269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:07.526407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 315/617] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:07.527551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.538571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.554220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55862bf4-9a87-4f39-8878-be2adb10cbe5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.590499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.591108 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.591392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.591671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.630951 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72474-5cdc-4123-bf27-a2fea037f37d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.663272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.664800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.665125 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.665755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.666041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.666313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.673707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.675143 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:07.686615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:07.692322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 316/618] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:07.693808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.719127 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.748588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.765008 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 303/619] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:07.765946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.791500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1f8b-43b1-48e5-bb91-a8b5f07d7e4b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.826596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.827296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.827583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.827861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.828617 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=a3307a556ec14aec850542633862b57a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.828935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.830375 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.837018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 317/620] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/role_assignments?user.id=a3307a556ec14aec850542633862b57a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.837813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.873189 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968883b0-5675-42dd-8fea-de90a0fafbe6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:07.916577 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:07.917211 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:07.917497 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:07.917776 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:07.918574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:07.918875 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:07.920345 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:07.947491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 304/621] 10.222.0.91 () {56 vars in 1139 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:07.947491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:07.957358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:07.967443 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92605-d865-4fd6-8e7b-26751e50cfe7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.003105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.010486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.011278 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.011688 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.012128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.013233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:08.013546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.015015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.036852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 318/622] 10.222.0.91 () {56 vars in 1137 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:08.037798 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.075446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e2baf-1e30-44ad-ad70-5c474baa6167 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.118572 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.119380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.119762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.120186 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.130682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.132338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:08.148133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:08.149859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:08.150934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:08.150934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.150934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:08.151559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 305/623] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:08.153376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.159172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004ac5d-cfd2-4194-b5e3-bd6c8c272db3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.197754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.198471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.199168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.199523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.221031 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.264121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.271435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cff-af63-451a-be90-08016563b9c6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.277705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.279182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.311015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.312250 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.313094 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.313828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.384146 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 319/624] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:08.389647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.399597 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.400726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.445105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.501310 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac38e-63d5-472c-8005-7f705593ba41 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.504615 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.511948 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 306/625] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:08.516787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.543177 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.544090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.544537 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.544936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.545580 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:08.545882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.548137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.561777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 320/626] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:08.562689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.622837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd8982-d44b-4031-a54f-671926bb0a04 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.659650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.660283 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.660693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.660993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.669991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314312-74a3-4bb7-b0e8-4fedf87afbfb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.671233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.672743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.682099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:08.687692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:08.688680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:08.689584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:08.689584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.689584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:08.689584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 307/627] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:08.689584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.715296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.715926 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.716208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.716521 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.727629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.729125 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:08.744039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:08.745210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:08.746114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:08.746114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:08.746114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:08.746114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 321/628] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:08.746345 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.747296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.804265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aefc7-d0ab-42b7-b920-ceb3302dbcfa None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.839148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.839781 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.840063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.840343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.847029 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.848534 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.849964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b76e-05c6-439a-b401-89b446ab9827 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:08.860646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:08.861574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 308/629] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:08.867628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.893169 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:08.893775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.894055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.894322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.894961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:08.895442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:08.896871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:08.910403 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 322/630] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:08.911401 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:08.940876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.981336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c05ffc-8fc2-48d7-a419-134890e529f9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:08.990437 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.017599 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.018309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.018599 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.018880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.019534 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.019841 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.021303 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.029764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a283e9-5661-4490-ab89-0b243850e16b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.041833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 309/631] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.041833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.074263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.075036 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.075415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.075793 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.076624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.077027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.078542 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.090692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 323/632] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.091618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.157882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0feccd-d44c-4e38-a529-fbf11494afd1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.183712 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.194932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.196143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.196578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.196736 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.202028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0d8c-75ab-49ed-9ddb-f44e2c9a8e8f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.203895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.205379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:09.217925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:09.219063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:09.220665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 310/633] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:09.227366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.247059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.247698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.248102 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.248278 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.255011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.256462 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.258983 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:09.268602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:09.274268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 324/634] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:09.275179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.394243 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3e52-6d6d-49ab-ae1e-9432f50505a6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.432540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.433244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.433602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.434065 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.434835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.435222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.436687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.449763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 325/635] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.450393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.453222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.467719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826236c-4440-4fca-a14d-4bd0bde147d3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.502626 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.503323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.503671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.504005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.504844 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=71640ebebcef490e9f3425f7559e3b57) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.505222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.506697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.524543 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 311/636] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/role_assignments?user.id=71640ebebcef490e9f3425f7559e3b57&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.524543 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.592807 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d50e2-7e86-4be4-8206-d6d585d954f2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.634274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.644227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5003b-0164-4e75-a5d0-883bd3ac1a41 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.666982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.667905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.668192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.668488 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.669443 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.670198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.671727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.689731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.690067 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 326/637] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.690269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.690557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.690832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.691642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=ab7ee24711494e088ca175321680612f) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.691882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.693350 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cddd-0263-4418-bf9c-98ae411339ea None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.701707 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 312/638] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/role_assignments?user.id=ab7ee24711494e088ca175321680612f&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.702138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.775946 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.821168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ac73-01a3-4532-b955-d5fd39e94e2e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.862221 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.862941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.863298 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.863648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.864558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=d0fb7270ef9444348b30a65938ede20a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.864903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.866495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf89f-4d19-4fca-af7c-7e98db0c0dcd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.873909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 327/639] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/role_assignments?user.id=d0fb7270ef9444348b30a65938ede20a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:10.170469 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786acc-65d4-4ae4-8ae3-93aa59cac222 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:10.170853 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786acc-65d4-4ae4-8ae3-93aa59cac222 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:10.171209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786acc-65d4-4ae4-8ae3-93aa59cac222 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:10.172960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 313/640] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:10.178570 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:10.178981 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:10.179370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:10.198730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:10.200100 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:10.274109 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 328/641] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:10.613356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786acc-65d4-4ae4-8ae3-93aa59cac222 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:10.720014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786acc-65d4-4ae4-8ae3-93aa59cac222 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:10.755323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:10.755959 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:10.756245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:10.756552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:10.768074 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:10.773032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:10.774476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:10.775405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 314/642] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:10.780448 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:10.841618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:10.890841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb710e2-15a5-48b2-9e51-5a79518cd3d2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:10.928119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:10.928770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:10.929050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:10.929321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:10.930292 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:10.930706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:10.932137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:10.940796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 329/643] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:10.947045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:10.972799 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:11.062952 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f81f-d07f-4bcc-b4af-e1364ebea5a0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:11.102827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:11.103455 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:11.103735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:11.104009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:11.114607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:11.116044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:11.131610 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:11.132623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:11.133565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:11.133565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:11.133565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:11.133565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 315/644] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:11.140217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:11.250657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a59a-71c6-4b99-9c1b-ea7219952604 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:11.269034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:11.287312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:11.288221 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:11.288763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:11.289818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:11.290683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:11.291196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:11.292794 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:11.305572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 330/645] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:11.311813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:11.384752 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:11.423233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2429ba-123b-477f-a08e-627dcbb37ddf None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:11.458856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:11.459485 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:11.459761 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:11.460032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:11.468728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:11.470102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:11.481892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:11.482861 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:11.483813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 316/646] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:13:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:11.489362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:11.600400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6daa6-3473-4db0-b4aa-6329ff5387f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:11.637301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:11.638183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:11.638462 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:11.638735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:11.639465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:11.639769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:11.641248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:11.660884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 331/647] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:13:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:11.666310 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:11.786431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0129a0-6b49-4eeb-9d5d-b21223d8b90a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:11.817632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:11.827809 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:11.828795 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:11.829251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:11.829694 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:11.911863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:11.913736 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ab52-d771-4fc8-a0ca-2200f994b1f8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.019715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 317/648] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:12.025358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.052022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204cda9-720d-4ed3-8071-811eccff9434 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.052307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204cda9-720d-4ed3-8071-811eccff9434 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.052539 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204cda9-720d-4ed3-8071-811eccff9434 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.054001 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 318/649] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:13:12.058507 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276d81d-3cdf-4f57-b8a2-0eb56c582bed None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.058796 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276d81d-3cdf-4f57-b8a2-0eb56c582bed None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.059076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276d81d-3cdf-4f57-b8a2-0eb56c582bed None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.060427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 319/650] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:13:12.063393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4377-7759-4ad4-b87a-f033f82e43d9 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.063672 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4377-7759-4ad4-b87a-f033f82e43d9 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.064183 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4377-7759-4ad4-b87a-f033f82e43d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.071901 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.083864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-acbd4377-7759-4ad4-b87a-f033f82e43d9 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:12.085126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-acbd4377-7759-4ad4-b87a-f033f82e43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:12.113292 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.149671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2cc4-e141-40ff-ae3a-e0a512b3711d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.164419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 320/651] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:12.169741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d012e7-8f4d-4122-be69-baee4d6bc84f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.170030 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d012e7-8f4d-4122-be69-baee4d6bc84f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.170305 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d012e7-8f4d-4122-be69-baee4d6bc84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.189223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-06d012e7-8f4d-4122-be69-baee4d6bc84f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:12.190483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-06d012e7-8f4d-4122-be69-baee4d6bc84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:12.197362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.198294 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.199360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.199865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.214393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.216485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:12.236826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:12.238019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:12.239214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:12.239214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:12.239214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.239214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 332/652] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:12.244262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.266908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 321/653] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:12.268243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609188e-40a2-4f36-8bae-252015e634f4 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.268557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609188e-40a2-4f36-8bae-252015e634f4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.268835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609188e-40a2-4f36-8bae-252015e634f4 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.270399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 322/654] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:12.277677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.278028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.278262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.306274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:12.307569 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:12.356818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.375087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219c4c-930f-406b-9d80-918dee27a2d1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.392095 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 323/655] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:12.418492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.419411 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.419875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.420357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.421198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:12.421775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.423323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.435711 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 333/656] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:12.441311 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.462127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.507593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.563799 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ba3f-1104-4b68-95a3-3d6c515f8dde None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.610121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.610758 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.611040 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.611315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.618560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.620040 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:12.631335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:12.632259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:12.633816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:12.634248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf50e-9a4a-44a5-b80e-176f6c33569e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.636787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 324/657] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:12.637633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.671151 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.671685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.671969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.672248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] PATH_INFO: `/v3/services/network` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.672874 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.674246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:12.685999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:12.687114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.687962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 334/658] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:12.688847 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.705311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.728885 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.751650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346ac7-232a-4128-a5be-bad6de3c9100 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.787274 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.787903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.788189 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.788497 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] PATH_INFO: `/v3/services/image` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.789112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.790541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.792080 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25eff8-9667-414b-a84c-34f6f057dafa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:12.801069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:12.802242 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:12.803078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 325/659] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:12.804012 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.830223 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.830752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.831035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.831313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.832125 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:12.832457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.834054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.845909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 335/660] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:12.846768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.904139 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0c430-3262-4e9d-ae7b-eea912783a3c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.916558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.938462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.939063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.939344 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.939618 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.940244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] RBAC: Adding query filter params (name=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:12.940595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.941944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.946960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 326/661] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:12.947437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c66b2-1c2a-41f3-ab1d-c26d6a8ac35a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.947741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.957245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.981637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.982342 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.982626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.982904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.983484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.984888 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:12.994017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:12.995012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:12.995853 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 336/662] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:12.996695 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:13.052964 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d445-57a6-4c2e-869d-b8fba21be900 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.087894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.088421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.088735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.089015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.089709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] RBAC: Adding query filter params (name=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.090011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.091374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.095592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 327/663] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:13.096355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:13.101161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d1ae-eb1d-4df2-9db3-356b19b1aa2a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.136118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.136747 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.137024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.137294 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.138271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=a3307a556ec14aec850542633862b57a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.138577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.140117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.142986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:13.146431 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 337/664] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/role_assignments?user.id=a3307a556ec14aec850542633862b57a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=27562aa899b24a498ff1887ceca94449 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:13.147208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:13.170686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:13.206631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5a8e-e650-4383-abaa-4d3b41783639 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.253014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.253780 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.254134 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.254489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.255145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.255514 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.257050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.271662 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 328/665] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:13.272802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:13.277162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366670-e50b-4713-a031-4c0f72355086 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.319832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.320563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.320964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.321320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.321970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.322340 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.323794 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.334141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 338/666] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:13.335367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:13.415975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:13.425164 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678d95-2809-4008-b8c9-792e301260e4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.464501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940e14-4de8-4b98-915b-0f9d62e31519 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:13.473179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.473835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.474121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.474397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.475042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] RBAC: Adding query filter params (type=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.475349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.477560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b97f7-9b6c-4230-a40c-5917e2303bab None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.478980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:13.483974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 329/667] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:13.514346 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:13.515319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.515762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.516220 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.517076 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:13.517564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:13.519205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff7528-dd8c-4ef1-a8d0-24852d9c8265 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:13.527086 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 339/668] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:15.428153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6f5d-2b65-43e3-ba3f-8ae7514ec46c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.428756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6f5d-2b65-43e3-ba3f-8ae7514ec46c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.428756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6f5d-2b65-43e3-ba3f-8ae7514ec46c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.430505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 330/669] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:15.436556 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141240-e30f-4cf9-9cd0-25b0f57c1da2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.437060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141240-e30f-4cf9-9cd0-25b0f57c1da2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.437167 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141240-e30f-4cf9-9cd0-25b0f57c1da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.456120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8f141240-e30f-4cf9-9cd0-25b0f57c1da2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:15.457404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8f141240-e30f-4cf9-9cd0-25b0f57c1da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:15.531682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 340/670] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:15.581616 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2dc2-95e7-4282-b330-7e70454ba6ed None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.581946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2dc2-95e7-4282-b330-7e70454ba6ed None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.582206 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2dc2-95e7-4282-b330-7e70454ba6ed None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.583855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 331/671] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:15.589491 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364058-86c0-4b02-a131-cf819d2256c6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.589779 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364058-86c0-4b02-a131-cf819d2256c6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.590062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364058-86c0-4b02-a131-cf819d2256c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.615309 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e6364058-86c0-4b02-a131-cf819d2256c6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:15.616663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e6364058-86c0-4b02-a131-cf819d2256c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:15.678124 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:15.692677 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 341/672] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:15.780701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631e7a-0ac1-47de-b1c7-1cfae741497a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.781005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631e7a-0ac1-47de-b1c7-1cfae741497a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.781439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631e7a-0ac1-47de-b1c7-1cfae741497a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.783195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 332/673] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:15.788852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.789313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.792597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.793924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0aba-d0d3-49f0-b757-c00d409a2a55 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.794206 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0aba-d0d3-49f0-b757-c00d409a2a55 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.794483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0aba-d0d3-49f0-b757-c00d409a2a55 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.795758 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 333/674] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:13:15.801144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.801498 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.801856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.814170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:15.815654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:15.821540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:15.822800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:15.897803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 342/676] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:15.900482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 334/676] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:13:15.905303 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.009332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f283e6-6332-410d-be11-69c903bf25c8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.027994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:16.031061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.052262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.053103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.053520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.053934 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.068055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:16.074506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:16.075449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:16.076502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 343/677] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:16.081336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.175846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17aad-d651-4d5f-9cbb-c31a4588aaaf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.199208 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b33b-dd9b-4fa8-ba06-24823a7fe1e4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.207443 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:16.219461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.222436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.222436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.222436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.222436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.223486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.241600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.243040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.243330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.243607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.244280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:16.244652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.246063 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.254574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 344/678] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:16.255358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.297461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:16.307547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 335/679] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:16 2022] POST /identity/v3/services => generated 240 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:16.307547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.370815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1553d-0270-4297-9681-6fc03dfd14cd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.424701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.425647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.425937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.426654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.427608 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.430355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.433521 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a717a-f106-48e4-87b0-3804d9257e2e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.471424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.472073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.472351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.472657 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.473318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.474698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.506116 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 345/680] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:16 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:16.506902 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.553130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 336/681] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:16 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:16.636783 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:16.650970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ccd-e692-4b49-8be9-ae1fa1f7e552 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.701689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.702349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.702883 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.703160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.715673 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.717297 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:16.734233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:16.735257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:16.736702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:16.736702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:16.736702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:16.736702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 346/682] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:16.741567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:16.800388 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:16.861130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe79df-2d27-4d09-b98c-7e47b1b85678 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:16.899174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:16.899789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.900117 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.900393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.901072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:16.901372 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:16.902726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:16.916373 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 337/683] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:16.923226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.030861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a71f4-a9e8-49be-a617-3148a173382e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.068914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.069553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.069832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.070105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.078524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.079988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.082764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:17.092415 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:17.100886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:17.102426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 347/684] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:13:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:17.103263 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.215671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05801ab-dcdb-4f13-ad7f-f8309b95e37c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.227367 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.254523 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.255237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.255590 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.255876 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.256677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:17.256994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.259631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.278754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 338/685] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:17.283830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.387762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72b0cb-732e-4d90-a32c-667c222690f7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.427593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.428623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.429132 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.429612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.441381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.443129 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:17.458468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:17.459412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:17.460306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:17.460306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:17.460306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:17.462496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 348/686] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:17.472575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.575296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e88d-42c6-4035-a581-6e6aaea9a01b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.612045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.612680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.612968 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.613244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.613941 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:17.614248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.615724 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.628512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 339/687] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:17.634018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.700324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.752237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7aa80-3abc-40d6-be75-35893d100ec1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.787976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.788643 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.788932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.789366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.796512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.797966 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:17.809905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:17.810886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:17.811821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 349/688] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:17.818686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.849655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.927819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f573b-b6f2-4d53-8f6d-58fb1200c5fb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.965023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.965946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.966438 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.966937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.967912 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:17.968522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.970187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a57cc4-c098-4838-81bb-33989afe641f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.983108 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 340/689] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:17.989349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:18.094444 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4521cd-9394-47f0-8144-5c29052697e3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.112625 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.135235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.136138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.136650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.137075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/a3307a556ec14aec850542633862b57a/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.139477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=a3307a556ec14aec850542633862b57a, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:18.141119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1614399-4766-4bb6-9791-1ce66042bce2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:18.198906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 350/690] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:13:17 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/a3307a556ec14aec850542633862b57a/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:13:18.763820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a2ee-e10b-46a4-8480-07cfee524949 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.764372 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a2ee-e10b-46a4-8480-07cfee524949 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.764372 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a2ee-e10b-46a4-8480-07cfee524949 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.765943 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 341/691] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:18.771379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9191a7-91c0-4d6c-b103-d98cfca3c9a5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.771784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9191a7-91c0-4d6c-b103-d98cfca3c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.771972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9191a7-91c0-4d6c-b103-d98cfca3c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.791771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-db9191a7-91c0-4d6c-b103-d98cfca3c9a5 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:18.793008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-db9191a7-91c0-4d6c-b103-d98cfca3c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:18.858573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfbfe-84fb-4e12-b839-a63accae42c8 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.858573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfbfe-84fb-4e12-b839-a63accae42c8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.858870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfbfe-84fb-4e12-b839-a63accae42c8 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.864525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 342/692] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:18.866119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb34e-3b90-4cc1-a8e4-5fa850dceb12 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.866642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb34e-3b90-4cc1-a8e4-5fa850dceb12 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.866642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb34e-3b90-4cc1-a8e4-5fa850dceb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.876487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 351/693] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:18.886125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-8c7eb34e-3b90-4cc1-a8e4-5fa850dceb12 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:18.887341 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8c7eb34e-3b90-4cc1-a8e4-5fa850dceb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:18.957432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 343/694] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:19.022749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ab4a-8efa-4bc9-9ce6-98faba8df6e7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.023039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ab4a-8efa-4bc9-9ce6-98faba8df6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.023222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ab4a-8efa-4bc9-9ce6-98faba8df6e7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.024904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 352/695] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:19.030091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.030389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.033403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.049481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:19.050686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:19.062587 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.122999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 344/696] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:19.212986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ab4a-8efa-4bc9-9ce6-98faba8df6e7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.308485 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.322331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ab4a-8efa-4bc9-9ce6-98faba8df6e7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.324541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.361051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.361688 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.361964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.362234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] PATH_INFO: `/v3/services/network` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.362818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.364178 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:19.374830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:19.375858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:19.376799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:19.380811 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 353/697] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:19.382117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.450208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96bf96-15a4-48d0-a5a3-3b457bc9602d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.492346 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879c091-da0e-474b-87cc-71f82f4f4b47 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.498356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.499308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.499802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.500314 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.501147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.502732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:19.513126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:19.514399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:19.515227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.519374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 345/698] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:19.520200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.533176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.536668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.537309 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.537544 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.537826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.538459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] RBAC: Adding query filter params (name=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.538765 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.540804 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.545408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 354/699] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:19.546226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.583615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.627556 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6538-651c-4308-972f-146619dc9ee2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.659582 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddb95-4b1a-4d02-a40d-a8022f724e36 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.661956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.662586 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.662870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.663144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.663732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.665185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:19.673847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:19.674872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:19.675711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 346/700] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:19.676578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.706142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.707011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.707532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.707963 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.708903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.709473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.711029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.720961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 355/701] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:19.721993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.763491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.788364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a607-4865-4816-bf50-752fa01d6447 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.824933 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.825543 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.825825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.826100 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.826731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] RBAC: Adding query filter params (type=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.826866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:19.827287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.828382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.833222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 347/702] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:19.834059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.835085 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae708-fe5a-4aa7-bc47-db03959ed1d5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.874018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.874636 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.874923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.875202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.875834 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.876137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.877535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.882241 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 356/703] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:19.882241 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.946004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb95ddb-2534-46ab-be30-88efcdcd8988 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.987825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.990645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.990645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.990645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.990645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] RBAC: Adding query filter params (type=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.990645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.991122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b75a-59d7-4288-8db6-fec5e5e23a38 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.992654 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.003104 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 348/704] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:20.004207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.007762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:20.031361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.031982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.032267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.032592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.033309 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] RBAC: Adding query filter params (interface=public, service_id=bcc6d389dd8147e095d8df23c9d69ef4, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:20.033620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.035002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.042730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 357/705] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:19 2022] GET /identity/v3/endpoints?service_id=bcc6d389dd8147e095d8df23c9d69ef4&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:20.043543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.072919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:20.116221 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9634b-0b70-4e3d-9613-68583d868219 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.153653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.154285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.154568 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.154842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.155488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:20.155791 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.157224 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.168155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 349/706] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:20.168155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.250384 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:20.282824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c602f0-4129-4023-b9ac-577bd3bece90 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.292506 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5305a4-3357-4479-8de4-6e6985e1f61a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.323437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.324053 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.324333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.324661 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.325359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] RBAC: Adding query filter params (interface=public, service_id=ba687bfd4cf04ce38c9137898fe52431, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:20.325664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.327024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.332176 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 358/707] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/endpoints?service_id=ba687bfd4cf04ce38c9137898fe52431&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:20.332864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.332986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.333732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.334022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.334298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.334908 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.336335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.342398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 350/708] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:13:20.343200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.450110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:20.468226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26283-183d-4ac6-af16-bf9457805bce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.496176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd34e-eee9-4508-9d6c-89b022906b66 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.509406 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.510204 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.510495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.510772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.511492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] RBAC: Adding query filter params (interface=public, service_id=ffb393d7befe491496b4b2b9a87ad3a9, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:20.511808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.513578 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96112b4-4e04-41c5-ba75-3e75a7217a43 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.524286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 359/709] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/endpoints?service_id=ffb393d7befe491496b4b2b9a87ad3a9&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:20.524286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ded9-8c9b-4a89-af98-287b6c55701c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.524286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ded9-8c9b-4a89-af98-287b6c55701c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.524286 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ded9-8c9b-4a89-af98-287b6c55701c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.525510 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 360/710] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:20.529796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ded9-8c9b-4a89-af98-287b6c55701c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:20.530419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:20.536631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.537253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.537539 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.537818 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.538435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.540350 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe132-25c5-41de-9a4d-88c4e2917d45 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.545917 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 351/711] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/services => generated 1002 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:13:20.547066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.548665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.548665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.572328 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:20.574014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:20.661798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 352/712] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:20.677740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ded9-8c9b-4a89-af98-287b6c55701c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:20.718928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:20.719524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:20.719806 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:20.720126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:20.720785 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:20.722166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:20.729506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 361/713] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/services => generated 1002 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:13:21.000977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.113365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89611-bd40-4686-8ff1-8032414d4e73 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.138260 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.151194 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.151838 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.152124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.152425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.162944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:21.168828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:21.169766 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:21.170641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 353/714] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:21.176692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.195129 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.294654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5360b-88ba-4e20-a030-5ed21bb41103 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.330145 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.331046 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.331529 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.331985 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.332863 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:21.333342 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:21.334870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:21.344709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 362/715] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:21.356464 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.459039 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249db55-c9c4-4aa6-b4c4-286bd655f779 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.496255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.496934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.497227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.497505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.508294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:21.509925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:21.525393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:21.526347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:21.527225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:21.527225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:21.527225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:21.527225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 354/716] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:21.532384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.619407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.642775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf265f-6f84-4b2b-9050-b282fa714041 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.679648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.681123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.681500 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.681917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.682564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:21.682867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:21.684228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:21.697149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 363/717] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:21.702720 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.744679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.815016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5a871-ce0d-4f19-aadb-312ce6e22eb4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.851251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.852271 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.852743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.853181 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.860935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:21.862631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:21.876502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:21.877691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:13:21.878896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:21.881176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 355/718] 10.222.0.91 () {56 vars in 1093 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:21.887789 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.995757 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e882-980c-45d7-9b01-99f6a4d6d2eb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.032110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.032996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.033494 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.033919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.034839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:22.035316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.036930 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.039987 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.056400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 364/719] 10.222.0.91 () {56 vars in 1133 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:22.062370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.165611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.171546 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2140846-9adb-4a7d-ab97-4ba1b9f39270 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.207615 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.208234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.208574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.208826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.284221 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.285711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.394419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.400172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.404578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 356/720] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:22.511697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdce49-4131-41a8-a3d5-d169a538ca70 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.547150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.547784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.548066 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.548338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.559382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.560880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:22.576426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:22.577470 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:22.578384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:22.578384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:22.578384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:22.578384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 365/721] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:22.584950 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.700897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fe1a-f29d-4714-81fd-4bb2b591a2e9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.742336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.743511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.744003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.744510 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.745366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:22.745878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.747474 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab38d8f-b647-4a43-b33c-c2c429b85ce3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.761235 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 357/722] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:22.767864 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.797926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0760186-abcb-407c-8b85-ab4573315182 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.798548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0760186-abcb-407c-8b85-ab4573315182 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.799056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0760186-abcb-407c-8b85-ab4573315182 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.801021 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 358/723] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:13:22.808478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6972e-941f-4cd3-b378-cb1d38228cc5 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.809192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6972e-941f-4cd3-b378-cb1d38228cc5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.809786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6972e-941f-4cd3-b378-cb1d38228cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.827099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.835414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0da6972e-941f-4cd3-b378-cb1d38228cc5 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:22.838126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0da6972e-941f-4cd3-b378-cb1d38228cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:22.891446 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedb80-0c53-419b-9640-ae3faec9e954 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.907475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.924638 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 359/724] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:22.925905 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc381b9-394b-4df8-97b5-aeff8aaec0a3 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.926200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc381b9-394b-4df8-97b5-aeff8aaec0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.926476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc381b9-394b-4df8-97b5-aeff8aaec0a3 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.927894 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 360/725] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:22.933378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f771-6a4c-4411-b2bd-a014f47b2534 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.933675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f771-6a4c-4411-b2bd-a014f47b2534 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.933960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5f771-6a4c-4411-b2bd-a014f47b2534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.938284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.939191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.939682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.940196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.949621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.951382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.953160 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-aab5f771-6a4c-4411-b2bd-a014f47b2534 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:22.954396 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-aab5f771-6a4c-4411-b2bd-a014f47b2534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:22.964602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:22.965531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:22.966459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:22.973397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 366/726] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:22.974481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.031713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 361/727] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:23.032948 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f92c-1146-42fc-8a96-06bb17c30132 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.033238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f92c-1146-42fc-8a96-06bb17c30132 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.033505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f92c-1146-42fc-8a96-06bb17c30132 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.034962 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 362/728] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:23.046189 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.046520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.046800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.069096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:23.071809 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:23.095001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cab2b-70f6-4e0d-bea3-e06ce4d5a833 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.103330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.131689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.132325 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.132663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.133498 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.134412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:23.134721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.136152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.154934 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 367/729] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:23.155878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.174684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 363/730] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:23.276892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf27c2-8d2b-4442-9517-34552f3dcaae None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.286795 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.316219 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.316860 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.317147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.317426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.318469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=a3307a556ec14aec850542633862b57a) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:23.318788 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.320227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.327838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 368/731] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/role_assignments?user.id=a3307a556ec14aec850542633862b57a&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=27562aa899b24a498ff1887ceca94449 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:23.356864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.392562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.423884 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55231d-4259-4501-9a49-a62d0de9a7a3 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.431913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.472267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.473002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.473287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.473562 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] PATH_INFO: `/v3/services/network` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.474218 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.475650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:23.486023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:23.487285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:23.488481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 364/732] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:23.497659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.523396 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071f8f-9407-4cae-bc42-e970a0bec2a6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.565328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.565890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.566171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.566444 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] PATH_INFO: `/v3/services/image` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.567030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.568399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:23.578136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:23.579195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.580228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 369/733] 10.222.0.91 () {56 vars in 1105 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:23.582187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.633932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34ec12-4323-4d85-ba6f-51dc170f3564 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.645358 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.669450 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.670056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.670339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.670622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.671254 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] RBAC: Adding query filter params (name=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:23.671559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.672966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.678451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 365/734] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:23.679249 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.693020 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.700701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee4b-f017-46ba-b967-deb08f5c3dbe None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.738197 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.738838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.739120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.739393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.739976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.741377 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:23.751130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:23.752316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:23.753360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 370/735] 10.222.0.91 () {56 vars in 1129 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:23.759154 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.790849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba625e4-cbfa-4428-991a-35de45879071 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.833796 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.834509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.834793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.835068 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.836890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] RBAC: Adding query filter params (name=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:23.837204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.839111 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.845410 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 366/736] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:23.846233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.875198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263449c-3e4e-463e-96b9-2cf577a5cdf8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:23.894083 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.911851 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:23.912658 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:23.913044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:23.913421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:23.914191 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:23.914599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:23.916034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:23.925631 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 371/737] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:23.925631 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:23.949226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.966557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f15a0-e804-41be-ba9d-fc664efdf441 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.003022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.003820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.004167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.004545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.005248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:24.005622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.007285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.017097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 367/738] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:24.017097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:24.031382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9cd61-02fe-45a1-91e5-0ba20a892fb0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.066629 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.067238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.067524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.067802 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.068432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:24.068766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.070137 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.076479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 372/739] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:24.076479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:24.130040 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2d91-33f3-486d-ac10-7cd8864fb1a2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.131854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:24.166871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:24.167055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.167646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.167834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.168096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.168794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.170156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.184250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d873d-bab0-44e5-a43f-7e2dc9bc26c0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.218772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.219381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.219660 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.219932 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.220598 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:24.220904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.222267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.232502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 373/740] 10.222.0.91 () {56 vars in 1124 bytes} [Tue Aug 23 23:13:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:24.233216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:24.332486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76aacf-7c8b-448f-a701-a1ce4c7beea9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.345430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 368/741] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:24.346373 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:24.393724 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.395331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.395870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.396645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.397690 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.401693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4990-ba21-411d-9b1b-03ecfac88bef None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.487736 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88a37-7016-4b81-886d-fe58439e903c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.488508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 374/742] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:24.561112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.561749 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.562033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.562310 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.563153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:24.564544 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434dbe5-87db-4641-9deb-ce80227e1db7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:24.633362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 369/743] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:25.649809 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec56f5-2ece-4214-8c88-5511675e94f5 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.650419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec56f5-2ece-4214-8c88-5511675e94f5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.650419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec56f5-2ece-4214-8c88-5511675e94f5 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.651727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 375/744] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:25.657760 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.658239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.658336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.676234 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:25.677468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:25.681913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:25.753733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 370/745] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:26.077296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec56f5-2ece-4214-8c88-5511675e94f5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:26.080156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:26.183458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec56f5-2ece-4214-8c88-5511675e94f5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:26.221646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:26.222515 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.222998 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.223458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.224230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:26.225818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:26.237472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:26.238518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:26.239707 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:26.241862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 376/746] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 23 23:13:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:26.248057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:26.350665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260c2f-ca35-42b0-86a0-806ae3784aa3 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:26.385726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:26.386336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.386619 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.386895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.387528 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:26.387832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:26.389487 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59cc48-f623-4908-b637-03cc53279920 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:26.391446 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:26.400103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 371/747] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:26.402238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:26.469829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:26.505238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329acc-2771-4018-8253-3162db5587e2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:26.541257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:26.541871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.542152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.542426 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.543059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:26.543363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:26.544756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4e6e-07da-44b7-81e6-d5af9fda64f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:26.549442 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 377/748] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:26.768502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154bed-8720-494f-9b05-c897b312cb0c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.769054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154bed-8720-494f-9b05-c897b312cb0c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.769054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154bed-8720-494f-9b05-c897b312cb0c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.770530 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 372/749] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:26.776242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de479e1-1e56-4525-b02b-a55000202bf4 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.776708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de479e1-1e56-4525-b02b-a55000202bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.776904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de479e1-1e56-4525-b02b-a55000202bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.795090 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0de479e1-1e56-4525-b02b-a55000202bf4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:26.796297 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0de479e1-1e56-4525-b02b-a55000202bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:26.864383 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 378/750] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:26.905129 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e0b1-f380-43f6-8b99-cd40a5876c48 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.905473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e0b1-f380-43f6-8b99-cd40a5876c48 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.905698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e0b1-f380-43f6-8b99-cd40a5876c48 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.907153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 373/751] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:26.912243 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:26.912585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:26.912867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:26.932222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:26.933458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:26.989007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.001349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 379/752] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:27.194005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e0b1-f380-43f6-8b99-cd40a5876c48 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.311347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e0b1-f380-43f6-8b99-cd40a5876c48 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.336489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.347368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.347983 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.348279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.348609 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.415538 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.417989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.419519 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.444601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b9d2-4446-43ec-b641-54a68c8c09f6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.480618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.481255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.481545 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.481819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.482405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.483770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:27.493126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:27.494245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:27.495120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 380/753] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:27.499967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.530825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 374/754] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:27.536542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.561983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.607305 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b423-d027-4192-bb5d-f96f2c11f291 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.642579 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.643193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.643480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.643758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.644387 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:27.644727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.646100 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.651646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 381/755] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:27.657347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.658922 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.662150 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3049a-3851-4d62-a81c-c125d2126bd3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.703812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.704422 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.704770 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.705052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.716109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.717595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:27.732989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:27.734007 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:13:27.734901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:27.734901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:13:27.734901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:27.734901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 375/756] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:27.740975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:27.773217 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4908575-27f3-4bfa-9071-2a0188f9d91b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.790553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.808166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.809106 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.809596 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.809961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.810492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:27.810795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.812157 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a5922-a944-46f6-b2be-453ce424d7c2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.816538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 382/757] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:27.853726 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9789-13ef-4921-9142-b1a02bcfac2c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:27.892025 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:27.892727 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.893016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.893293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.893951 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:27.894260 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:27.895644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c9193-6a1b-4677-b0e8-20d2e4c0ea25 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:27.916484 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 376/758] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:28.784289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc962a-9335-46dc-9052-7776418c56a5 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:28.784606 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc962a-9335-46dc-9052-7776418c56a5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:28.784888 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc962a-9335-46dc-9052-7776418c56a5 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:28.786258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 383/759] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:28.792231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a186b-698e-4132-979d-3b4ad4de3022 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:28.792557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a186b-698e-4132-979d-3b4ad4de3022 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:28.792842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a186b-698e-4132-979d-3b4ad4de3022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:28.811237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-108a186b-698e-4132-979d-3b4ad4de3022 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:28.812452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-108a186b-698e-4132-979d-3b4ad4de3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:28.820077 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:28.879910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 377/760] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:28 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:29.210129 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc962a-9335-46dc-9052-7776418c56a5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:29.310694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc962a-9335-46dc-9052-7776418c56a5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:29.343471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:29.344068 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:29.344347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:29.344647 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:29.345279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:29.346641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb44e1-07ad-4356-ae7b-f74c48b4762a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:29.415142 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 384/761] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:29 2022] POST /identity/v3/services => generated 269 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:30.037187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff338-03d1-4350-9793-764bb29705c6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:30.037718 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff338-03d1-4350-9793-764bb29705c6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:30.037718 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff338-03d1-4350-9793-764bb29705c6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:30.039073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 378/762] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:30.044561 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299fa8-5c39-488a-807a-391d8baf2c08 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:30.044854 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299fa8-5c39-488a-807a-391d8baf2c08 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:30.045133 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299fa8-5c39-488a-807a-391d8baf2c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:30.063356 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-16299fa8-5c39-488a-807a-391d8baf2c08 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:30.064646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-16299fa8-5c39-488a-807a-391d8baf2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:30.103123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:30.140723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 385/763] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:30 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:30.464086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ff338-03d1-4350-9793-764bb29705c6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:30.568257 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ff338-03d1-4350-9793-764bb29705c6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:30.602630 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:30.603237 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:30.603524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:30.603801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:30.604478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:30.605849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f5a9b-00ee-436e-b354-8f5800059948 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:30.722903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 379/764] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:30 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:31.622664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed098b9-9a8b-4f4e-b1e6-0c79cb6371e2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:31.623202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed098b9-9a8b-4f4e-b1e6-0c79cb6371e2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:31.623314 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed098b9-9a8b-4f4e-b1e6-0c79cb6371e2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:31.624762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 386/765] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:31.630066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:31.630488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:31.630625 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:31.637566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:31.649899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:31.651090 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:31.723442 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 380/766] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:32.048662 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed098b9-9a8b-4f4e-b1e6-0c79cb6371e2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:32.148656 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed098b9-9a8b-4f4e-b1e6-0c79cb6371e2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:32.182496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:32.183120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.183402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.183676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.184255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:32.185665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:32.194259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:32.195193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:32.197134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 387/767] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 23 23:13:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:32.201797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:32.303675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b278321-dfe9-4b6f-98d0-1503f2417baf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:32.330504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:32.339084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:32.353475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:32.353920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 381/768] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:32.353992 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:32.385110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:32.455336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d037894-4db7-4d3b-ba4c-5c311ee1eaf1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:32.488417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:32.489055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.489337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.489612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.490242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:32.490546 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:32.491918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:32.497605 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 388/769] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:32.503493 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:32.606583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191024e-2749-4eab-83fe-79cd4c6d8bf4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:32.642463 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:32.643138 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.643389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.643665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.644365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] RBAC: Adding query filter params (interface=public, service_id=a9127f01f30d4a819fcec246fd639d59, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:32.644705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:32.646065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14dc4-79e0-4d40-8235-642c63062f04 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:32.653786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 382/770] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:32 2022] GET /identity/v3/endpoints?service_id=a9127f01f30d4a819fcec246fd639d59&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:32.659243 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:32.756250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:32.762351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b897-e20f-4a59-adf7-f8af21802fb6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:32.799118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:32.799741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.800023 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.800297 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.800956 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:32.802391 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c265-1e31-4548-8574-e5242f95352e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:32.809870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 389/771] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:32 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:13:33.005974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfee42-1a5c-4bf5-b04c-490d3b18cc31 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.006266 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfee42-1a5c-4bf5-b04c-490d3b18cc31 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.006548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfee42-1a5c-4bf5-b04c-490d3b18cc31 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.007916 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 383/772] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:33.014400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.014694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.014975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.035069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:33.036319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:33.110663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 390/773] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:33.481837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfee42-1a5c-4bf5-b04c-490d3b18cc31 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:33.543819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:33.589956 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfee42-1a5c-4bf5-b04c-490d3b18cc31 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:33.624079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:33.624734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.625021 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.625302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.625888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:33.627259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:33.635845 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:33.637061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:33.638099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 384/774] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:33.643312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:33.732726 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:33.742098 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368cbd5-114d-43c1-9491-ce94e0775b99 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:33.777363 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:33.777978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.778264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.778543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.779198 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:33.779487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:33.780913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:33.785562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 391/775] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:33.791910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:33.892948 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833953-57b2-42d4-a792-da66de5d3d4c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:33.913715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:33.928259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:33.933681 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:33.937772 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 385/776] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:33.944366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:34.044518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4cfc4-1bfd-4203-91ac-dd12afda6dfc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:34.078149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:34.078749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:34.079031 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:34.079306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:34.079999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] RBAC: Adding query filter params (interface=public, service_id=a81302983be2489d8135892ffda1fa49, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:34.080312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:34.081716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705cccb-ef8e-49d7-806d-cabdc8cb1340 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:34.087320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 392/777] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:33 2022] GET /identity/v3/endpoints?service_id=a81302983be2489d8135892ffda1fa49&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:34.093042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:34.190693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ad90-3f2f-4026-b3df-2245ee5e0f02 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:34.224949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:34.225558 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:34.225966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:34.226161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:34.226762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:34.228358 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841604bd-b362-4bdf-9793-c439f0c00774 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:34.244491 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 386/778] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:34 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:13:35.050522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d349-76e3-4eab-992d-5afaed347f90 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:35.051057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d349-76e3-4eab-992d-5afaed347f90 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:35.051057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d349-76e3-4eab-992d-5afaed347f90 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:35.053174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 393/779] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:35.058469 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:35.058899 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:35.059013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:35.076856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:35.078027 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:35.120634 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:35.143542 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 387/780] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:35.478371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d349-76e3-4eab-992d-5afaed347f90 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:35.497573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:35.580878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d349-76e3-4eab-992d-5afaed347f90 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:35.613898 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:35.614523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:35.614807 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:35.615084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:35.615662 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:35.617052 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:35.625744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:35.626826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:35.627790 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 394/781] 10.222.0.91 () {56 vars in 1132 bytes} [Tue Aug 23 23:13:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:35.632733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:35.730103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebb290-880c-453a-a9c3-702e5670b63e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:35.762975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:35.763576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:35.763857 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:35.764374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:35.765035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:35.765338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:35.766695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:35.771198 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 388/782] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:35.777645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:35.858247 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:35.875756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cb567-b5bc-4a2a-bfa0-3d0de0e490e9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:35.910835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:35.911439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:35.911722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:35.917837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:35.917837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:35.917837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:35.917837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd08f-683d-4934-b237-cc739e29f460 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:35.919455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 395/783] 10.222.0.91 () {56 vars in 1126 bytes} [Tue Aug 23 23:13:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:35.925258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:35.970026 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:36.028013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cfeeb-f33b-44b3-b99d-1c026b792e3e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:36.065352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:36.065992 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.066220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.066499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.067174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:36.068574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3925-d2fc-4b04-ba3b-f29d0664376f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:36.136196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 389/784] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:13:36.447942 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359929-ee74-4752-899f-60a222e6b34f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.448503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359929-ee74-4752-899f-60a222e6b34f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.448618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359929-ee74-4752-899f-60a222e6b34f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.449862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 396/785] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:36.455265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.455562 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.455840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.474014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:36.475217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:36.548240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 390/786] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:36.879316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a359929-ee74-4752-899f-60a222e6b34f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:36.979455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a359929-ee74-4752-899f-60a222e6b34f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:37.012592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:37.038316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:37.038905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:37.040050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:37.041184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 397/787] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:37.041969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:37.061804 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:37.137140 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312f31-634b-4d7a-9693-644a81ceff00 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:37.172185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:37.172826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.173113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.173394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.174050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:37.174354 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:37.175717 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:37.181037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 391/788] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:37.186962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:37.200891 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:37.293595 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b8e1-9490-4b0b-9fa1-17989216813c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:37.335817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:37.336502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.336928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.337211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.337842 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:37.338146 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:37.339553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135afb8-03f5-443a-8d77-71ae905591b6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:37.344186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 398/789] 10.222.0.91 () {56 vars in 1114 bytes} [Tue Aug 23 23:13:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:37.349973 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:37.438226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:37.449986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd84dc-ef07-4377-bc8e-da04e2aa6c09 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:37.484400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:37.485030 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.485315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.485593 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.486264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:37.487630 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0906-8b5f-4ec5-a8b5-c92526b32756 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:37.580512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 392/790] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:38.365355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ffe2-3505-4730-8703-0eca8d326337 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:38.365882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ffe2-3505-4730-8703-0eca8d326337 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:38.365882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ffe2-3505-4730-8703-0eca8d326337 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:38.367240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 399/791] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:38.373197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:38.373619 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:38.373733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:38.392301 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:38.393526 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:38.464235 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 393/792] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:38.799844 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2ffe2-3505-4730-8703-0eca8d326337 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:38.875518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:38.902087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2ffe2-3505-4730-8703-0eca8d326337 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:38.936304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:38.936957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:38.937244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:38.937523 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:38.938107 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:38.939473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:38.948659 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:38.949666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:38.950507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 400/793] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:38.955702 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:39.024340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:39.055683 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844bdb2-2db6-4304-b780-65cc3b9eb982 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:39.090719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:39.091323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.091609 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.091885 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.092553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:39.092864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:39.094227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed626c-a93b-40a3-8d7e-f252c4b88d2e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:39.098835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 394/794] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:39.104737 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:39.204510 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3572-d80c-48b7-ab1e-f6726be9a052 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:39.238917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:39.239529 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.239812 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.240088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.240753 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:39.241083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:39.242434 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46adb8-4cbb-4f52-88c2-39acb36d2e80 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:39.247427 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 401/795] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:39.837047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effe38-69f7-4855-8140-088ff4ad0f8b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.837611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effe38-69f7-4855-8140-088ff4ad0f8b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.837611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effe38-69f7-4855-8140-088ff4ad0f8b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.839032 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 395/796] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:39.845073 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.845490 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.845602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.851839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:39.864178 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:39.865407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:39.933762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 402/797] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:40.262072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6effe38-69f7-4855-8140-088ff4ad0f8b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.369842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6effe38-69f7-4855-8140-088ff4ad0f8b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.404300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.404932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.405215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.405490 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.406126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.407561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.410161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING keystone.server.flask.common [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:13:40.413381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.453352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.sql.core [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:13:40.453352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:13:40.453352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [parameters: {'id': 'b959fac1bc454495974f4bc3855623a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:13:40.453352 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b959fac1bc454495974f4bc3855623a2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b959fac1bc454495974f4bc3855623a2. Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:13:40.470366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 23:13:40.471347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application yield resource Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise self.value Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application session.commit() Aug 23 23:13:40.472397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:13:40.473392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:13:40.474322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:13:40.475136 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [parameters: {'id': 'b959fac1bc454495974f4bc3855623a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:40.476047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:40.478790 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b959fac1bc454495974f4bc3855623a2. Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:40.479913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 396/798] 10.222.0.91 () {60 vars in 1140 bytes} [Tue Aug 23 23:13:40 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:40.480782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.577420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0df1c-7d91-4462-9cdd-9d4601d5d880 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.608573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.612713 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.613345 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.613621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.613892 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.620710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.622147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-372fed53-c18a-4ba6-acda-d1a7e0197d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:13:40.632841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:40.634215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:40.636138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 403/799] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:40.640631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.739179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3535e76-3b81-4402-919e-40f8bc4ee889 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.772617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.773220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.773501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.773773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.774457 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:40.774760 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.776360 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32952a4-c564-49e9-bf49-86ac1974e23c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.795934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 397/800] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:41.455821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8bd2-8d33-4c26-8008-469877f875bd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:41.456369 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8bd2-8d33-4c26-8008-469877f875bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:41.456369 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8bd2-8d33-4c26-8008-469877f875bd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:41.457719 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 404/801] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:41.463258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41b7a-e6de-4a99-a6e0-86a0c0a6c9b1 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:41.463697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41b7a-e6de-4a99-a6e0-86a0c0a6c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:41.463825 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb41b7a-e6de-4a99-a6e0-86a0c0a6c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:41.481981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-4cb41b7a-e6de-4a99-a6e0-86a0c0a6c9b1 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:41.483441 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-4cb41b7a-e6de-4a99-a6e0-86a0c0a6c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:41.532580 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:41.553522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 398/802] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:41 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:41.882010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8bd2-8d33-4c26-8008-469877f875bd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:41.984557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8bd2-8d33-4c26-8008-469877f875bd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:42.019032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:42.019640 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:42.019918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:42.020194 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:42.020886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:42.022259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471968a8-ee2d-4af5-824e-4aa5c157627b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:42.088506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 405/803] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:13:41 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:43.059561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575d52-b9f5-406b-a89f-6cf2aa28a750 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.060086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575d52-b9f5-406b-a89f-6cf2aa28a750 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.060178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575d52-b9f5-406b-a89f-6cf2aa28a750 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.061541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 399/804] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:43.066855 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.067310 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.067404 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.085190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:43.086391 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:43.133397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.159452 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 406/805] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:43 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:43.489919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575d52-b9f5-406b-a89f-6cf2aa28a750 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.593380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575d52-b9f5-406b-a89f-6cf2aa28a750 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.628059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.628698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.628990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.629268 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.629913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.631414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.683000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.sql.core [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:13:43.683000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:13:43.683000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [parameters: {'user_id': '61b2f2d0aea246f4abb334c45f07bd27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:13:43.683000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 23 23:13:43.689515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:13:43.690525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application yield resource Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise self.value Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application session.commit() Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:13:43.691909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:13:43.692958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:13:43.693830 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:13:43.694650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [parameters: {'user_id': '61b2f2d0aea246f4abb334c45f07bd27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:43.696967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 23:13:43.698823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:43.700245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 400/806] 10.222.0.91 () {60 vars in 1131 bytes} [Tue Aug 23 23:13:43 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:43.700755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.797359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22332f-6624-4e97-95ba-ad80c063581b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.831702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.832338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.832649 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.832924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.840015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.841499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5e4c9d3b-dd9e-4342-88d2-b8a98f925de7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:13:43.853573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:43.854525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:43.856188 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 407/807] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:43.860621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.906061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.962947 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faae6-1436-40b3-b794-873d2a69761f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.998309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.998914 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.999201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.999477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.000179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:44.000518 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:44.002202 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50237627-1a6d-4f09-9e94-0869fae39021 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:44.052668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 401/808] 10.222.0.91 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:44.307135 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326394e7-2496-4e27-bb2d-81ac6f9c8810 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.307637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326394e7-2496-4e27-bb2d-81ac6f9c8810 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.307637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326394e7-2496-4e27-bb2d-81ac6f9c8810 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.308967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 408/809] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:44.314521 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.314935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.315079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.333637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:44.335158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:44.401891 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 402/810] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:44 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:44.728493 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326394e7-2496-4e27-bb2d-81ac6f9c8810 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:44.769140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:44.827436 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326394e7-2496-4e27-bb2d-81ac6f9c8810 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:44.861361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:44.861980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.862264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.862541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.863123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:44.864513 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:44.873501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:44.874654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:13:44.875705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 409/811] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:44.880554 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:44.910748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:44.979911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f28d8-feb3-4dee-bfbc-805d306e4d44 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:45.014925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:45.015563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.015864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.016152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.016840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] RBAC: Adding query filter params (name=compute) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:45.017148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:45.018573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:45.023285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 403/812] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:45.029552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:45.129084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab54a9-4596-4c17-a21f-68f21d7f5cc1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:45.130614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:45.163231 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:45.163832 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.164121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.164397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.165621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:45.165924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:45.167299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:45.171939 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 410/813] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:45.177968 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:45.269036 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:45.275860 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc07fc-d949-4aaf-8ffe-b6b4ee477b1c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:45.308548 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:45.309148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.309431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.309708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.310402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] RBAC: Adding query filter params (interface=public, service_id=0057976686cf413fa20cf31ba74371f2, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:45.310710 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:45.312132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc20ea4-8482-402a-b9e5-5e0947d110fc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:45.317015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 404/814] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:13:45 2022] GET /identity/v3/endpoints?service_id=0057976686cf413fa20cf31ba74371f2&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:45.323242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:45.423718 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011296-ee0e-4e97-bae2-b10f6d2cc5ea None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:45.457236 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:45.457836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.458118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.458392 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.458997 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:45.460365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ca6bf-2e8c-4ba7-a595-965a9ddb2296 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:45.467127 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 411/815] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:13:45 2022] GET /identity/v3/services => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:13:47.662626 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2b83-244e-48e8-94f1-bb485b3d15ac None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:47.663176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2b83-244e-48e8-94f1-bb485b3d15ac None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:47.663176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2b83-244e-48e8-94f1-bb485b3d15ac None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.664529 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 405/816] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:47.670660 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:47.671058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:47.671199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.690051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:47.691241 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:47.715021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:47.758539 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 412/817] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:47 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:48.089776 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2b83-244e-48e8-94f1-bb485b3d15ac None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:48.194158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2b83-244e-48e8-94f1-bb485b3d15ac None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:48.228541 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:48.229174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:48.229456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:48.229733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:48.230315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:48.231675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:48.240219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:48.241405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:13:48.242262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 406/818] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:13:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:48.247259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:48.348220 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0c1b-9956-453d-9821-2b3ddf4f108c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:48.381371 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:48.381974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:48.382254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:48.382527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:48.383149 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:48.384037 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:48.385440 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:48.390335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 413/819] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:48.396199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:48.421419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:48.495422 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0313c-d445-4a5d-a3c7-62b75b9d80a6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:48.529275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:48.529869 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:48.530151 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:48.530425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:48.531047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:48.531351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:48.532734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c1ea6-60d7-409a-b9df-137ed43b9b96 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:48.537374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 407/820] 10.222.0.91 () {56 vars in 1112 bytes} [Tue Aug 23 23:13:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:48.543417 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:48.567749 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:48.643893 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110affa-4203-47d6-b08c-f86eb5ce9f91 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:48.677597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:48.678192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:48.678465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:48.678739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:48.679389 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:48.681524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1bc1-45e0-4181-9c70-8bdf205d2936 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:48.751264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 414/821] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:13:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:58.535073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=57 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:58.747042 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:08.395389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81643ef-359b-4e0b-9d17-8a682421c86a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:08.395970 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81643ef-359b-4e0b-9d17-8a682421c86a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:08.395970 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81643ef-359b-4e0b-9d17-8a682421c86a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:08.397363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 408/822] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:08.402602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:08.403019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:08.403199 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:08.421813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:08.423028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:08.495405 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 415/823] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:08.828003 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81643ef-359b-4e0b-9d17-8a682421c86a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:08.929559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81643ef-359b-4e0b-9d17-8a682421c86a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:08.962789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:08.963412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:08.963696 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:08.963969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:08.974735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:08.976170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:08.990969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:08.992143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:08.993340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:08.993340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:08.993340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:08.993340 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 409/824] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:08.998385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:09.099440 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dd1fe-87fd-4de2-9dc2-a67a114d905a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:09.124905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:09.133403 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:09.134013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:09.134299 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:09.134577 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:09.135216 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:09.135521 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:09.136964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3b2b1-0d77-4ae8-8516-b747d4d77fc0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:09.148805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 416/825] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:09.154637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:09.209389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:09.255821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec3e5f-9405-4717-aa5e-32ca1265c177 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:09.290881 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:09.291507 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:09.291788 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:09.292062 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:09.292929 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:09.294382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4c09b-61fd-4b9e-b5bf-c3c20dad0a98 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:09.392336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 410/826] 10.222.0.91 () {60 vars in 1132 bytes} [Tue Aug 23 23:15:09 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:15:11.632716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a7cc-981e-4a73-8a14-3aac9a5162db None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.633233 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a7cc-981e-4a73-8a14-3aac9a5162db None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.633334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a7cc-981e-4a73-8a14-3aac9a5162db None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.634607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 417/827] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:11.640121 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.640574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.640727 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.658885 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:11.660690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:11.726430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 411/828] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:12.054967 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4a7cc-981e-4a73-8a14-3aac9a5162db None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.156309 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4a7cc-981e-4a73-8a14-3aac9a5162db None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.190096 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.190761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.191056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.191364 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.201202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:12.205887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:12.207518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:12.208732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 418/829] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:12.213802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.254880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.313973 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e05f4-c111-4e01-ba7d-a02bb885e881 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.348169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.348802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.349086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.349362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.350021 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:12.350326 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.351818 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.360596 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 412/830] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:12.366506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.414507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.466290 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12072d-48c2-4b4e-a43b-a0eb7606e9e8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.499608 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.500235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.500723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.501001 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.512203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.513737 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:12.528941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:12.531300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:12.532190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:12.532190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:12.532190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:12.532190 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 419/831] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:12.536114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.633217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.636295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd060fab-0bdd-4a64-a4d3-879d2134c9f1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.670353 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.670958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.671233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.671513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.672226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:12.672563 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.673936 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.685613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 413/832] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:12.691896 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.788324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.792271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7560-d702-4947-af47-5124060248fd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.826559 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.827186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.827538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.827817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.834702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.836139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:12.847594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:12.851429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:12.852769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 420/833] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:12.854793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.956207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e574543-f00b-462b-a4e7-3c1d18d6fe4f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.990426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.991167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.991623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.992052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.992867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:12.993236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.994747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.012013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 414/834] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:13.017886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:13.119120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44919ea-1658-4afe-a19a-8e018d4d507d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:13.152287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:13.152914 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:13.153196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:13.153468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:13.180141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:13.219990 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:13.221481 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.320372 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 421/835] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:13.328684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:13.350873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:13.433694 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789610-9224-4ff1-840d-b5af92086a4a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:13.466747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:13.467362 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:13.467688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:13.467912 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:13.478409 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:13.488343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:13.494515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:13.495608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:13.496801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:13.496801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:13.496801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:13.496801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 415/836] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:13.501874 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:13.560100 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:13.602540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30727-092c-4c84-b91a-28fe47ba93fd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:13.638568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:13.639173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:13.639457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:13.639729 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:13.640367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:13.640704 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:13.642128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.654779 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 422/837] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:13.660989 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:13.729817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:13.759834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149f6f-eb9a-4111-8b11-7c81686c4dd7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:13.793797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:13.794420 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:13.794701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:13.794974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:13.801742 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:13.803208 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:13.814979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:13.816169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:13.817748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 416/838] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:13.822210 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:13.922676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553be38-0726-4ab9-8d12-8838bcba7009 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:13.939495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:13.955868 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:13.956564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:13.957375 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:13.957691 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:13.958384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:13.958696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:13.960130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5259955-c3f8-43f3-a9c3-27742443936a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:13.971989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 423/839] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:13.978028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:14.076379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f3370-f34e-40b7-ace7-c12128376395 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:14.105355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:14.111169 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:14.111776 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:14.112061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:14.112337 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:14.113371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=1b02617b277d4205a247fbae67b78732) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:14.113685 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:14.115117 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb150b-a4ff-46f5-85ef-4bbe909cb83d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:14.120302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 417/840] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:15:13 2022] GET /identity/v3/role_assignments?user.id=1b02617b277d4205a247fbae67b78732&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:16.292180 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b266c2-4dbb-4955-9f2f-1d52c3ec41bd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:16.292799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b266c2-4dbb-4955-9f2f-1d52c3ec41bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:16.292799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b266c2-4dbb-4955-9f2f-1d52c3ec41bd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:16.294167 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 424/841] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:16.299293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:16.299696 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:16.299868 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:16.318215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:16.319412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:16.386317 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 418/842] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:16.713748 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b266c2-4dbb-4955-9f2f-1d52c3ec41bd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:16.818121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b266c2-4dbb-4955-9f2f-1d52c3ec41bd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:16.851265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:16.851889 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:16.852172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:16.852478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:16.863906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:16.868824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:16.869907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:16.870813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 425/843] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:16.876101 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:16.975897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13119-4b3c-46a8-adf8-74a18da4900a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:16.998988 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.009634 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.010259 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.010528 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.010808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.011474 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:17.011789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.013185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.021631 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 419/844] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:17.027421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.068994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.128226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81eae3-77d9-43d8-9fbe-2e9d7498b9c8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.162640 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.163267 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.163550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.163828 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.173650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.175167 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:17.189862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:17.191095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:17.192227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:17.192227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:17.192227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:17.192227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 426/845] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:17.197080 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.300863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb663e72-006d-4a53-9114-5897cf905d22 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.334476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.335078 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.335364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.335640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.336278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:17.336628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.337977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.350100 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 420/846] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:17.356148 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.449833 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.459358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df59b-ab9a-4490-bb5c-cc7c0fc1ac34 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.492780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.493410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.493692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.493968 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.500916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.502348 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:17.514245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:17.515341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:17.516533 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 427/847] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:17.521764 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.568821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.621308 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341cdd7-a446-4b18-b2f7-22044cd164d8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.655002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.655655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.655937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.656212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.657125 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:17.657436 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.658870 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.676840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 421/848] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:17.682612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.781763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c328a2f-775a-4a95-bd77-43c9ae1cc049 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.814994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.815613 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.816040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.816326 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.826750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.828113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:17.842101 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:17.848641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:17.850689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:17.850689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:17.850689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:17.850689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 428/849] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:17.850966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.950196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5c00-b573-4d4b-908d-792571b2e26e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.952460 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.983719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.984342 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.984648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.984920 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.985555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:17.985921 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.987272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.999119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 422/850] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:18.005651 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:18.008611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:18.105785 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1dc8-6b3e-46a7-9dff-f933fc0fc1a9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:18.139701 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:18.140326 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:18.140652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:18.140929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:18.147812 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:18.149288 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:18.160296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:18.161357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:18.162437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 429/851] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:18.167173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:18.268773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91ef6-8f5f-4822-a489-45245d1ad82c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:18.303307 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:18.303980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:18.304181 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:18.304482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:18.305167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:18.305476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:18.306910 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440515b-3f63-48d4-a07b-d92315bffd08 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:18.318827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 423/852] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:18.324783 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:18.386348 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:18.425070 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0819ae-c15b-4a97-821f-7b8a6f023b0f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:18.458604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:18.459256 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:18.459538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:18.459814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/1b02617b277d4205a247fbae67b78732/roles/94850633c10a4dfa91a4c24d920f7580` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:18.474486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=1b02617b277d4205a247fbae67b78732, role_id=94850633c10a4dfa91a4c24d920f7580)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:18.475931 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de702f-5cf7-4405-a8ec-5ba03c235aa3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:18.535696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 430/853] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:15:18 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/1b02617b277d4205a247fbae67b78732/roles/94850633c10a4dfa91a4c24d920f7580 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:15:20.723625 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f903-7a2c-40c3-8705-7493a41b517d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.724185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f903-7a2c-40c3-8705-7493a41b517d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.724185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f903-7a2c-40c3-8705-7493a41b517d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.725562 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 424/854] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:20.731179 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.735770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.735770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.749402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:20.750594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:20.816296 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 431/855] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:21.142428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f903-7a2c-40c3-8705-7493a41b517d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:21.168397 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.246750 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f903-7a2c-40c3-8705-7493a41b517d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:21.281400 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:21.282019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:21.282295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:21.282620 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:21.293045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:21.297735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:21.298832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:21.299813 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 425/856] 10.222.0.91 () {56 vars in 1102 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:21.305902 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:21.347852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.403683 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9487425-1e8c-4dae-8990-b4a9863234ad None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:21.441294 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:21.442119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:21.442400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:21.442675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:21.443327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:21.443628 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:21.445030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:21.452865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 432/857] 10.222.0.91 () {56 vars in 1103 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:21.459128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:21.548398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.564854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c13f-8c9b-4cbf-884f-0a9af9beee7c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:21.599511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:21.600174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:21.600512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:21.600793 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:21.611141 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:21.613374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:21.627511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:21.629174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:21.630128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:21.630128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:21.630128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:21.630128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 426/858] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:21.634995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:21.742366 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb34c-bbff-4727-8d6e-f4f81356fa9d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:21.744648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.776003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:21.776641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:21.776923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:21.777192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:21.777822 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:21.778124 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:21.779478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:21.790563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 433/859] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:21.796456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:21.897459 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0159a-27ce-469a-ba6c-1e97f4b7eb4b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:21.930525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:21.931144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:21.931424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:21.931695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:21.934399 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.939413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:21.941537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:21.952856 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:21.954018 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:21.955022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 427/860] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:21.960211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.073652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3bad2-07c2-4049-8be4-82585f26bc34 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.115373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.115981 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.116268 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.116583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.117603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:22.121969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.121969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.136960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 434/861] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:22.142748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.244895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4dc9-60cc-449c-8737-3ed0ba005a32 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.278102 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.278709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.278995 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.279272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.339919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:22.346219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.348387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.446907 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 428/862] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:22.453130 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.477972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:22.553949 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff633-200e-40ad-9bb8-949e9e0378b1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.589193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.589819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.590141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.590367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.600671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.602104 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:22.616614 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:22.617741 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:22.618903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:22.618903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:22.618903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:22.620587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 435/863] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:22.623839 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.717264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:22.723582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957b56-f20a-4b04-a103-74584ef59d2a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.756281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.756928 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.757186 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.757465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.758105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:22.758413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.759777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.772043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 429/864] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:22.777805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.853244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:22.878017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6197d4-ff2c-4070-9909-44e37906255d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.912710 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.913335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.913620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.913897 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.920428 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.921900 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:22.933543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:22.947244 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:22.948362 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 436/865] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:22.948934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:23.039504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664ef7-564f-42fa-ac5e-0f82fbb24ec5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:23.072833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:23.073434 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:23.073721 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:23.073998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:23.074680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:23.074988 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:23.076500 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca2cf-432d-4564-a3ac-8af64a78b699 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:23.088288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 430/866] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:23.094395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:23.194910 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cfe30-83ac-416f-934e-192dabbe28cf None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:23.229792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:23.230397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:23.230681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:23.230958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:23.231680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] RBAC: Adding query filter params (role.id=94850633c10a4dfa91a4c24d920f7580, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=1b02617b277d4205a247fbae67b78732) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:23.231989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:23.233461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a09439-528e-434b-8f97-a1f2d676323b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:23.235206 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:23.240305 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 437/867] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:15:23 2022] GET /identity/v3/role_assignments?user.id=1b02617b277d4205a247fbae67b78732&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=94850633c10a4dfa91a4c24d920f7580 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:25.459895 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccf89-e042-407f-8e5c-3865013b4063 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:25.460468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccf89-e042-407f-8e5c-3865013b4063 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:25.460468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccf89-e042-407f-8e5c-3865013b4063 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:25.461805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 431/868] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:25.467381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:25.467828 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:25.467936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:25.485970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:25.487159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:25.554786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 438/869] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:25.880425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcccf89-e042-407f-8e5c-3865013b4063 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:25.899322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:25.980421 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcccf89-e042-407f-8e5c-3865013b4063 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.014820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.015433 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.015713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.015987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.026829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:26.031452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:26.032598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:26.033800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 432/870] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:26.039323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.139097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e61b-a443-4444-bbd3-9ae772ed68e3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.165877 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:26.173508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.174119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.174439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.174826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.176052 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:26.176356 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:26.177766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:26.185685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 439/871] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:26.191823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.271300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:26.293777 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8fd5-6d6e-4221-b71c-4403078753c7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.327103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.327731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.328016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.328295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.338669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:26.340113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:26.354821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:26.357280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:26.358376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:26.358376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:26.358376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:26.358376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 433/872] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:26.361752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.463328 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6f5c2-a86c-440d-9f17-7918055d9dd6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.496761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.497381 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.497633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.497905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.498544 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:26.498845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:26.500215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:26.512736 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 440/873] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:26.518449 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.621693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac9432-44f8-4f99-814f-fb5904ceed0d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.648604 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:26.656275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.656937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.657222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.657501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.665330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:26.666888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:26.677994 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:26.679109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:26.680426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 434/874] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:26.684958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.735491 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:26.785805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652bc0-c026-4436-9ec7-bf72ea3cdad0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.819374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.820004 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.820282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.820593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:26.821320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:26.821624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:26.823049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:26.841058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 441/875] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:26.846850 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:26.948403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c21270-5e8c-4f6a-b495-7bba294c88a4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:26.981673 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:26.982272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:26.982557 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:26.982835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.038264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:27.051031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.052515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.151745 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 435/876] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:15:26 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:27.157817 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:27.259238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b578db-5240-4443-a50f-ebbe65fe07c8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:27.268393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:27.293948 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:27.294495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:27.294771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:27.295040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.304947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.306423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:27.321379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:27.322508 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:27.323755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:27.323755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:27.323755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:27.323755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 442/877] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:27.328378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:27.416020 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:27.428250 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cff622-3a49-4503-b737-565e56e79500 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:27.464023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:27.464677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:27.464964 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:27.465241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.465892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:27.466192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.467552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.479046 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 436/878] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:27.487873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:27.591689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c3d4-775e-435c-baa0-ecc53e25be8d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:27.625316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:27.625933 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:27.626214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:27.626489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.633627 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.635047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:27.647321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:27.648456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:27.649703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 443/879] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:27.654378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:27.752985 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7129aa-a765-49b8-8653-a7ffe314020e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:27.787523 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:27.788130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:27.788406 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:27.788709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.789390 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:27.789693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.791118 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92ec9-876d-4af9-b901-54f9bbc96cc7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.804194 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 437/880] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:27.811240 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:27.835688 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:27.913387 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afd4c-ee4b-4259-83a6-d6023079781a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:27.946768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:27.947356 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:27.947635 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:27.947905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:27.948666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=1b02617b277d4205a247fbae67b78732) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:27.948972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:27.950522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4945-e461-4ea5-bd9c-77205d987db9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:27.955689 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 444/881] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:15:27 2022] GET /identity/v3/role_assignments?user.id=1b02617b277d4205a247fbae67b78732&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=27562aa899b24a498ff1887ceca94449 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:30.140921 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0a44-9a1b-4468-8553-b49cb23bd69b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:30.141511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0a44-9a1b-4468-8553-b49cb23bd69b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:30.141511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0a44-9a1b-4468-8553-b49cb23bd69b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:30.142781 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 438/882] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:30.148663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:30.153829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:30.153829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:30.167711 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:30.169047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:30.237983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 445/883] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:30.575471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0a44-9a1b-4468-8553-b49cb23bd69b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:30.587076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:30.678241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0a44-9a1b-4468-8553-b49cb23bd69b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:30.712148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:30.712806 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:30.713139 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:30.718219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:30.723547 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:30.728173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:30.729392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:30.730309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 439/884] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:30.735505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:30.750432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:30.833798 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46b5f-bf19-45e3-a87e-e7a4e9d1a5b8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:30.868555 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:30.869160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:30.869444 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:30.869721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:30.870382 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:30.870705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:30.872147 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:30.880910 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 446/885] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:30.886686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:30.954831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:30.989430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a929f-3151-4922-942d-40eed763bc52 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.022723 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.023349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.023633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.023909 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.034301 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.036323 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:31.050002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:31.051329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:31.052427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:31.052427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:31.052427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:31.052427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 440/886] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:31.057300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.135704 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.158762 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a6af-d1c3-43bc-b8e7-9ca81ae5550f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.191150 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.192459 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.192808 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.193095 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.193726 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:31.194035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.195400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.207075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 447/887] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:31.213584 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.315042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66efa5-57cf-4701-a583-14d9ac197518 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.335379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.350462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.351085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.351371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.351648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.359023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.360456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:31.371209 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:31.372197 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:31.373561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 441/888] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:31.378112 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.478698 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321148d-a287-49cd-a790-0068df90c606 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.512257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.512882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.513170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.513449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.514165 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:31.514520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.515953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.518760 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.534056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 448/889] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:31.539946 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.639565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f702a-5754-4afd-81d9-edcaa918b4d8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.672711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.673376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.677611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.677611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.685703 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.687148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:31.701473 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:31.702582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:31.703815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:31.703815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:31.703815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:31.703815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 442/890] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:31.708254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.808919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966766df-b784-4ed0-9959-8124609500d7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.844113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.844752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.845036 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.845311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.845954 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:31.846260 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.847624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.859566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 449/891] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:31.865839 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.898715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.965114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd708565-aae4-49a7-9a84-41591a079e4d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.998434 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.999058 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.999339 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.999614 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:32.006456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:32.013367 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:32.019708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:32.020798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:32.022033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 443/892] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:32.026690 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:32.082359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:32.126265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04626e5-a773-415d-8b80-008b574e47db None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:32.159805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:32.160484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:32.161226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:32.161503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:32.162184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:32.162486 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:32.163917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f585d9e-bd3d-4a99-84f4-1b91a0884a14 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:32.177122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 450/893] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:32.184463 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:32.276843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:32.285458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcf7f0-2071-4125-a5a3-0a7ff8a95371 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:32.318513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:32.319167 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:32.319451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:32.319730 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] PATH_INFO: `/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/1b02617b277d4205a247fbae67b78732/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:32.321688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5d81bcdbc149a880b2a9bd41ce67ad, user_id=1b02617b277d4205a247fbae67b78732, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:32.323200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca22c8-3919-4e82-be76-d083223f43f7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:32.404394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 444/894] 10.222.0.91 () {58 vars in 1439 bytes} [Tue Aug 23 23:15:32 2022] PUT /identity/v3/projects/9a5d81bcdbc149a880b2a9bd41ce67ad/users/1b02617b277d4205a247fbae67b78732/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:15:34.584805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242d42-a3b8-4e61-8071-ac7078dbb69b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:34.585337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242d42-a3b8-4e61-8071-ac7078dbb69b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:34.585337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242d42-a3b8-4e61-8071-ac7078dbb69b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:34.586677 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 451/895] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:34.591890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:34.592317 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:34.592472 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:34.610971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:34.612194 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:34.678718 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 445/896] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:35.011824 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12242d42-a3b8-4e61-8071-ac7078dbb69b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.113393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12242d42-a3b8-4e61-8071-ac7078dbb69b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.127031 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:35.148395 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.149060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.149343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.149618 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.160175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:35.165035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:35.168575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:35.169600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 452/897] 10.222.0.91 () {56 vars in 1096 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:35.172239 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.260744 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:35.279045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f22ed-a681-44c8-ab2b-2b485d9c9674 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.312549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.313156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.313483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.313756 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.314419 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:35.314725 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:35.316079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:35.324970 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 446/898] 10.222.0.91 () {56 vars in 1099 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:35.330959 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.428516 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07749-4655-4806-99c0-3f74922f1490 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.462275 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.462890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.463169 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.463437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.473168 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:35.474815 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:35.489645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:35.490838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:35.492128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:35.492128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:35.492128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:35.492128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 453/899] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:35.497061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.603754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec067547-e84b-426b-80ee-2b173beabf43 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.639173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.639787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.640075 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.640357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.641037 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:35.641348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:35.642734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:35.655906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 447/900] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:35.661929 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.690039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:35.772122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5429-880c-415c-a659-b07d65bf2507 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.811005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.812060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.812583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.813058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.822611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:35.824927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:35.838532 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:35.839671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:35.840693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 454/901] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:35.845616 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:35.850182 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:35.959568 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26d21-0d4f-4a76-ba63-66dd34d0c2ae None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:35.996779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:35.997411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:35.997687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:35.997963 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:35.998703 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:35.999014 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:36.000461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:36.024608 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 448/902] 10.222.0.91 () {56 vars in 1143 bytes} [Tue Aug 23 23:15:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:36.030446 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:36.128821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:36.144839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86700-644d-40fa-b7b3-61d8d640b72a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:36.187254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:36.187866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.188160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.188458 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.268360 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:36.270643 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:36.375648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:36.394304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 455/903] 10.222.0.91 () {58 vars in 1282 bytes} [Tue Aug 23 23:15:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:36.401801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:36.481053 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:36.524120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f74f3-2168-43eb-a0a0-57e98a7d0c5b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:36.563113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:36.563753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.564055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.564338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.577520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:36.578984 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:36.595516 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:36.596774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:36.597695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:36.597695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:36.597695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:36.597695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 449/904] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:36.603347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:36.707738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ac454-e87a-4d0e-a241-91cf57ba0087 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:36.744761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:36.745300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.745587 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.745936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.746528 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:36.746831 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:36.748192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:36.760170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 456/905] 10.222.0.91 () {56 vars in 1109 bytes} [Tue Aug 23 23:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:36.766203 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:36.874509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd27d6-a9e1-4aab-a9a7-33452a857fd5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:36.888550 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:36.908889 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:36.909630 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.909913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.910187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.918081 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:36.919582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:36.931217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:36.932753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 23 23:15:36.933668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 450/906] 10.222.0.91 () {56 vars in 1111 bytes} [Tue Aug 23 23:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:36.938632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:36.986284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:37.039877 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dcc5c-43f5-414f-8fdd-05bd00881e32 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:37.073735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:37.074338 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:37.074623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:37.074900 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:37.075626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:37.075945 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:37.077408 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425088e-9a16-4cf9-8d54-7650596c88e9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:37.090038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 457/907] 10.222.0.91 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:37.096195 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:37.200701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cd06-e50f-48ea-9240-b232b987efff None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:37.242393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:37.243000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:37.243285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:37.243560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:37.244276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] RBAC: Adding query filter params (role.id=27562aa899b24a498ff1887ceca94449, scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad, user.id=1b02617b277d4205a247fbae67b78732) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:37.244633 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:37.246065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66723-b7dc-4120-897f-9d1576cb06b0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:37.251846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 451/908] 10.222.0.91 () {56 vars in 1374 bytes} [Tue Aug 23 23:15:37 2022] GET /identity/v3/role_assignments?user.id=1b02617b277d4205a247fbae67b78732&scope.project.id=9a5d81bcdbc149a880b2a9bd41ce67ad&role.id=27562aa899b24a498ff1887ceca94449 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:39.435263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260df1-078b-43af-ab0b-55a8f684f41a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:39.435792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260df1-078b-43af-ab0b-55a8f684f41a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:39.435792 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260df1-078b-43af-ab0b-55a8f684f41a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:39.437173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 458/909] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:39.443191 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:39.443644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:39.443740 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:39.461959 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:39.463143 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:39.492215 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:39.529028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 452/910] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:39.858398 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28260df1-078b-43af-ab0b-55a8f684f41a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:39.959919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28260df1-078b-43af-ab0b-55a8f684f41a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:39.967144 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:39.993353 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:39.993973 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:39.994255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:39.994528 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:39.995106 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:39.996497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:40.005682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:40.009696 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:40.010764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 459/911] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 23 23:15:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:40.012808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:40.111210 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7360e0-42a1-480c-b37b-67acfcc3d910 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:40.145587 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:40.146092 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:40.146376 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:40.146652 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:40.147281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:40.147578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:40.148985 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b9a1-efe8-4399-a5c3-34adb5ac5a63 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:40.153835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 453/912] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:40.159658 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:40.260994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662af3-2cbd-4a73-b002-bd57ec860616 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:40.295093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:40.295695 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:40.295979 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:40.296254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:40.296908 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:40.297211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:40.298572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299acaab-54f9-4d4f-91d1-93c7bd1f6193 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:40.303606 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 460/913] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:42.462280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc52b9-b1de-4eb7-8f27-84a5161a2f1c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:42.462828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc52b9-b1de-4eb7-8f27-84a5161a2f1c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:42.462828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc52b9-b1de-4eb7-8f27-84a5161a2f1c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:42.464144 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 454/914] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:42.469369 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca1c0-7df3-40b5-91fd-be8f57525178 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:42.469751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca1c0-7df3-40b5-91fd-be8f57525178 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:42.469871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca1c0-7df3-40b5-91fd-be8f57525178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:42.488225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8ccca1c0-7df3-40b5-91fd-be8f57525178 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:42.489502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8ccca1c0-7df3-40b5-91fd-be8f57525178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:42.515936 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:42.555597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 461/915] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:42.893016 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc52b9-b1de-4eb7-8f27-84a5161a2f1c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:42.924585 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:42.995753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc52b9-b1de-4eb7-8f27-84a5161a2f1c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:43.029911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:43.030513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:43.030797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:43.031073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:43.031775 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:43.033479 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571caf5-1c5f-4474-b6b6-2a339395d4cb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:43.131754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 455/916] 10.222.0.91 () {60 vars in 1141 bytes} [Tue Aug 23 23:15:42 2022] POST /identity/v3/services => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:15:45.326093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723a64-9270-4df1-82d2-2b3bd045b138 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.326620 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723a64-9270-4df1-82d2-2b3bd045b138 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.326745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723a64-9270-4df1-82d2-2b3bd045b138 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.327979 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 462/917] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:45.333638 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.334036 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.334200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.352876 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:45.354082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:45.426847 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 456/918] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:45 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:45.760820 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723a64-9270-4df1-82d2-2b3bd045b138 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:45.861021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723a64-9270-4df1-82d2-2b3bd045b138 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:45.895015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:45.895632 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.895912 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.896185 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.896786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:45.898174 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:45.906666 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:45.913530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:45.914551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 463/919] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 23 23:15:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:15:45.915532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:45.932743 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:46.020980 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d3e80-fcfa-4a1c-b1c7-a9bc4495a447 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:46.054684 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:46.055535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:46.056029 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:46.056990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:46.057663 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:46.057975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:46.059385 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:46.064499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 457/920] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:46.070437 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:46.100361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:46.171221 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f0f3e-bd03-4df9-ae9e-27142cac6b95 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:46.205433 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:46.206032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:46.206317 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:46.206593 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:46.207289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] RBAC: Adding query filter params (interface=public, service_id=2ef96712b17249dda928a0704aa6296f, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:46.208156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:46.209619 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e51e9-e850-424d-aac7-dcefaf062279 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:46.214737 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 464/921] 10.222.0.91 () {56 vars in 1251 bytes} [Tue Aug 23 23:15:46 2022] GET /identity/v3/endpoints?service_id=2ef96712b17249dda928a0704aa6296f&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:46.220796 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:46.303404 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:46.321432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3e0f-773b-4806-a548-219b0d3dd0f2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:46.355826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:46.356464 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:46.356737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:46.357011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:46.357690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:46.359430 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2d64-207c-4f1c-badb-b2f9da143fbf None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:46.366572 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 458/922] 10.222.0.91 () {56 vars in 1087 bytes} [Tue Aug 23 23:15:46 2022] GET /identity/v3/services => generated 1962 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:15:48.537803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524607-fc5d-476b-9603-b7c59bdfa553 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:48.538335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524607-fc5d-476b-9603-b7c59bdfa553 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:48.538335 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524607-fc5d-476b-9603-b7c59bdfa553 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:48.539592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 465/923] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:48.545115 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:48.545545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:48.552134 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:48.563277 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:48.564561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:48.630329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 459/924] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:48 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:48.972228 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7524607-fc5d-476b-9603-b7c59bdfa553 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:49.063834 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:49.073303 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7524607-fc5d-476b-9603-b7c59bdfa553 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:49.107230 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:49.107925 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:49.108269 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:49.108648 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:49.109239 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:49.110600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:49.119103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:49.120273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 23 23:15:49.121234 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 466/925] 10.222.0.91 () {56 vars in 1117 bytes} [Tue Aug 23 23:15:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:49.126204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:49.204619 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:49.228831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b084e1-3c7b-4b65-9a4c-f143d115c58a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:49.264006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:49.264647 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:49.264932 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:49.265206 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:49.265828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:49.266176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:49.267533 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdfadd-e884-46e1-a507-ea25885daae4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:49.273714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 460/926] 10.222.0.91 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:49.279497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:49.378681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88999-5a44-4661-bb95-9f39556cddb6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:49.413165 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:49.413916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:49.414205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:49.414483 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:49.415146 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:49.416548 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b1d8a-de7e-418c-8ca9-9ba815e0c472 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:49.570359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 467/927] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:15:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:15:59.269945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=30 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:59.565685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:26.797811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4265-e808-44bc-aa67-2e67b3d0257e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:26.798394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4265-e808-44bc-aa67-2e67b3d0257e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:26.798493 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4265-e808-44bc-aa67-2e67b3d0257e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:26.800816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 461/928] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:26.805771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd4bb-a0d7-4112-8455-e5f69c1f534d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:26.806212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd4bb-a0d7-4112-8455-e5f69c1f534d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:26.806334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd4bb-a0d7-4112-8455-e5f69c1f534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:26.890597 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-71dcd4bb-a0d7-4112-8455-e5f69c1f534d None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:26.891974 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-71dcd4bb-a0d7-4112-8455-e5f69c1f534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:27.028935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 468/929] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:27.369438 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909cf6-798f-4cde-90ae-8c957368b6ce None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:27.373805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909cf6-798f-4cde-90ae-8c957368b6ce None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:27.374149 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909cf6-798f-4cde-90ae-8c957368b6ce None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:27.375637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 462/930] 10.222.0.91 () {54 vars in 965 bytes} [Tue Aug 23 23:22:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:27.381984 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f85a-34b0-44cf-904f-311f2b707872 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:27.382280 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f85a-34b0-44cf-904f-311f2b707872 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:27.382558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f85a-34b0-44cf-904f-311f2b707872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:27.441117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d406f85a-34b0-44cf-904f-311f2b707872 None None] MFA Rules not processed for user `ab7ee24711494e088ca175321680612f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:27.442410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d406f85a-34b0-44cf-904f-311f2b707872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:27.485303 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:27.519108 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 469/931] 10.222.0.91 () {58 vars in 1062 bytes} [Tue Aug 23 23:22:27 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:27.528934 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909cf6-798f-4cde-90ae-8c957368b6ce None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:27.540087 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909cf6-798f-4cde-90ae-8c957368b6ce None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:27.543887 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:27.544514 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:27.544798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:27.545071 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:27.554841 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:27.556247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1ad1b-531a-4a8f-bf37-7e3bc1a00ed4 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:27.565536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 463/932] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:30.048411 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f908-b0f9-49d6-b37a-ccf2a5d3624b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:30.049026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f908-b0f9-49d6-b37a-ccf2a5d3624b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:30.049026 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f908-b0f9-49d6-b37a-ccf2a5d3624b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:30.050361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 470/933] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:30.056379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e294-bbe1-4482-acca-e2569a44f762 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:30.056942 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e294-bbe1-4482-acca-e2569a44f762 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:30.057022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e294-bbe1-4482-acca-e2569a44f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:30.078522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-faa8e294-bbe1-4482-acca-e2569a44f762 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:30.079808 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-faa8e294-bbe1-4482-acca-e2569a44f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:30.089033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 464/934] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:30.449222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18f908-b0f9-49d6-b37a-ccf2a5d3624b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:30.460858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18f908-b0f9-49d6-b37a-ccf2a5d3624b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:30.464482 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:30.465156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:30.465513 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:30.465867 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:30.475920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:30.477518 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e227e-6e6b-4e25-b09f-4f02d910937c service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:30.487550 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 471/935] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:33.359805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e28b-aacf-4b31-91cc-18a0883259e9 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:33.360333 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e28b-aacf-4b31-91cc-18a0883259e9 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:33.360488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e28b-aacf-4b31-91cc-18a0883259e9 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:33.361737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 465/936] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:33.367835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e394-bb1b-4ddb-9970-494d5ba311d0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:33.368348 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e394-bb1b-4ddb-9970-494d5ba311d0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:33.368557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e394-bb1b-4ddb-9970-494d5ba311d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:33.429809 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-57b5e394-bb1b-4ddb-9970-494d5ba311d0 None None] MFA Rules not processed for user `8cee1245b8dd4379baa944422244c293`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:33.431021 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-57b5e394-bb1b-4ddb-9970-494d5ba311d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:33.521214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 472/937] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:33 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:33.864987 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e28b-aacf-4b31-91cc-18a0883259e9 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:33.876247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e28b-aacf-4b31-91cc-18a0883259e9 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:33.880480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:33.881093 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:33.881374 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:33.881654 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:33.891768 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:33.893255 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bc0cd-3714-4ff7-b87e-5cf57157957c service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:33.905483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 466/938] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:33 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:22:36.942319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfbf4c-70f7-4c58-b693-4fc4d03ee21d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:36.942794 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfbf4c-70f7-4c58-b693-4fc4d03ee21d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:36.942901 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfbf4c-70f7-4c58-b693-4fc4d03ee21d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:36.944186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 473/939] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:36.949382 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650300de-0d95-4d37-a0f1-d43c82c300c0 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:36.949827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650300de-0d95-4d37-a0f1-d43c82c300c0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:36.949924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650300de-0d95-4d37-a0f1-d43c82c300c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:36.969443 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-650300de-0d95-4d37-a0f1-d43c82c300c0 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:36.970650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-650300de-0d95-4d37-a0f1-d43c82c300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:37.044866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 467/940] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:36 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:37.390512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfbf4c-70f7-4c58-b693-4fc4d03ee21d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:37.402206 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfbf4c-70f7-4c58-b693-4fc4d03ee21d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:37.405941 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:37.409343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:37.409343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:37.409343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:37.416469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:37.417911 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b385e-7779-452e-b85f-5dad20e82a49 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:37.427993 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 474/941] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:37 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:40.802038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038239d-2d1a-4590-8d05-f52774b7b037 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:40.802642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038239d-2d1a-4590-8d05-f52774b7b037 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:40.802642 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038239d-2d1a-4590-8d05-f52774b7b037 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:40.804504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 468/942] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:40.809949 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c924d-9a7d-4ac9-8484-f94db57dbb95 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:40.810436 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c924d-9a7d-4ac9-8484-f94db57dbb95 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:40.810551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c924d-9a7d-4ac9-8484-f94db57dbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:40.830253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-267c924d-9a7d-4ac9-8484-f94db57dbb95 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:40.831457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-267c924d-9a7d-4ac9-8484-f94db57dbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:40.841173 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 475/943] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:41.209396 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038239d-2d1a-4590-8d05-f52774b7b037 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:41.222942 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038239d-2d1a-4590-8d05-f52774b7b037 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:41.230848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:41.231465 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:41.231751 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:41.232029 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:41.243282 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:41.244800 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e34207-9f0c-45bc-8d27-f196c35b28ec service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:41.255265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 469/944] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:43.520270 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5236b7-fa05-445c-a7f5-10f83a809005 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:43.520821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5236b7-fa05-445c-a7f5-10f83a809005 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:43.520821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5236b7-fa05-445c-a7f5-10f83a809005 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:43.522128 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 476/945] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:43.527757 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5900-db5e-49c3-a0f5-e42f13ec10fb None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:43.528191 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5900-db5e-49c3-a0f5-e42f13ec10fb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:43.528313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5900-db5e-49c3-a0f5-e42f13ec10fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:43.547211 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d95a5900-db5e-49c3-a0f5-e42f13ec10fb None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:43.552347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d95a5900-db5e-49c3-a0f5-e42f13ec10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:43.556477 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 470/946] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:43.897657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5236b7-fa05-445c-a7f5-10f83a809005 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:43.908772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5236b7-fa05-445c-a7f5-10f83a809005 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:43.934502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:43.934502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:43.934502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:43.934502 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:43.934826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:43.934826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d866d-7569-4e16-a764-7d5777e47ae1 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:43.934826 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 477/947] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:46.161774 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a00a-656f-4481-a9f1-94806b247056 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:46.162223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a00a-656f-4481-a9f1-94806b247056 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:46.162330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a00a-656f-4481-a9f1-94806b247056 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:46.163927 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 471/948] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:46.169196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6893a-f774-4408-bf40-04b8a89b4476 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:46.169623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6893a-f774-4408-bf40-04b8a89b4476 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:46.169884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6893a-f774-4408-bf40-04b8a89b4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:46.189955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-60d6893a-f774-4408-bf40-04b8a89b4476 None None] MFA Rules not processed for user `8cee1245b8dd4379baa944422244c293`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:46.191775 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-60d6893a-f774-4408-bf40-04b8a89b4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:46.200551 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 478/949] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:46 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:46.549971 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5a00a-656f-4481-a9f1-94806b247056 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:46.561296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5a00a-656f-4481-a9f1-94806b247056 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:46.564815 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:46.565412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:46.565692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:46.566004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:46.575240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:46.576690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2ff82-2929-48bc-a6b8-f33634d8e566 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:46.586326 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 472/950] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:46 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:49.283054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4509e2-0675-4039-a000-ae4cc3348974 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:49.283918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4509e2-0675-4039-a000-ae4cc3348974 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:49.284196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4509e2-0675-4039-a000-ae4cc3348974 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:49.286122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 479/951] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:49.291457 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ca80-74dc-4ae1-ad6f-f2f919834fd8 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:49.291881 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ca80-74dc-4ae1-ad6f-f2f919834fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:49.292252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ca80-74dc-4ae1-ad6f-f2f919834fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:49.311683 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e332ca80-74dc-4ae1-ad6f-f2f919834fd8 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:49.313006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e332ca80-74dc-4ae1-ad6f-f2f919834fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:49.321055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 473/952] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:49.677464 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4509e2-0675-4039-a000-ae4cc3348974 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:49.688780 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4509e2-0675-4039-a000-ae4cc3348974 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:49.692839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:49.696734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:49.696734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:49.696734 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:49.703492 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:49.705005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce039-8700-40a1-b800-21258c2172bb service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:49.715376 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 480/953] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:51.999866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d24-7371-4d63-bee8-7b1bb9c859f6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:52.000405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d24-7371-4d63-bee8-7b1bb9c859f6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:52.000405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d24-7371-4d63-bee8-7b1bb9c859f6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:52.001799 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 474/954] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:52.007563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838050a-48f3-495d-84d7-e2ebef84c780 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:52.008020 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838050a-48f3-495d-84d7-e2ebef84c780 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:52.008117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838050a-48f3-495d-84d7-e2ebef84c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:52.028399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3838050a-48f3-495d-84d7-e2ebef84c780 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:52.029645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3838050a-48f3-495d-84d7-e2ebef84c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:52.037598 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 481/955] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:52.380063 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce80d24-7371-4d63-bee8-7b1bb9c859f6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:52.385985 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=65 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:52.392412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce80d24-7371-4d63-bee8-7b1bb9c859f6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:52.396122 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:52.396762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:52.397044 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:52.397318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:52.409119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:52.410574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6d33d-ee16-4844-b856-8e36768bc52c service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:52.423220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 475/956] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:55.075317 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2bb8-705e-43b9-9fc3-2be845bf3111 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:55.075882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2bb8-705e-43b9-9fc3-2be845bf3111 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:55.075882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2bb8-705e-43b9-9fc3-2be845bf3111 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:55.077265 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 482/957] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:55.083004 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d6066-16f7-4e0b-8f37-5d88ce3a47bd None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:55.083422 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d6066-16f7-4e0b-8f37-5d88ce3a47bd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:55.083560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d6066-16f7-4e0b-8f37-5d88ce3a47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:55.102851 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-257d6066-16f7-4e0b-8f37-5d88ce3a47bd None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:55.104055 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-257d6066-16f7-4e0b-8f37-5d88ce3a47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:55.111708 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 476/958] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:55 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:55.452369 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2bb8-705e-43b9-9fc3-2be845bf3111 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:55.458983 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:55.464761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2bb8-705e-43b9-9fc3-2be845bf3111 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:55.468281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:55.468915 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:55.469201 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:55.469479 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:55.479121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:55.480601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9103d-5376-4727-9298-6288d832be38 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:55.490213 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 483/959] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:55 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:00.008315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68334c6-4ba2-4cb1-80c5-2ea539783e28 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:00.008904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68334c6-4ba2-4cb1-80c5-2ea539783e28 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:00.008904 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68334c6-4ba2-4cb1-80c5-2ea539783e28 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:00.010329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 477/960] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:00.015588 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e410-339e-477f-9b79-d62accb60fa1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:00.016028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e410-339e-477f-9b79-d62accb60fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:00.016260 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e410-339e-477f-9b79-d62accb60fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:00.036537 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9441e410-339e-477f-9b79-d62accb60fa1 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:00.037767 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9441e410-339e-477f-9b79-d62accb60fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:00.045630 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 484/961] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:00.387827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68334c6-4ba2-4cb1-80c5-2ea539783e28 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:00.399697 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68334c6-4ba2-4cb1-80c5-2ea539783e28 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:00.403338 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:00.403939 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:00.404220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:00.404529 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:00.414837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:00.416332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8fbd-b9ce-4045-b5b9-273c3536ac35 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:00.427201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 478/962] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:03.520887 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f676-c9d1-4d3f-afb6-8ee66204d26f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:03.521418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f676-c9d1-4d3f-afb6-8ee66204d26f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:03.521418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f676-c9d1-4d3f-afb6-8ee66204d26f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:03.522727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 485/963] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:03.528388 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553bb7e-5317-4c5c-8fc8-bb6fd56eb12c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:03.528817 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553bb7e-5317-4c5c-8fc8-bb6fd56eb12c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:03.528998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553bb7e-5317-4c5c-8fc8-bb6fd56eb12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:03.549398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e553bb7e-5317-4c5c-8fc8-bb6fd56eb12c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:03.551047 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e553bb7e-5317-4c5c-8fc8-bb6fd56eb12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:03.558837 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 479/964] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:03 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:03.903225 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f676-c9d1-4d3f-afb6-8ee66204d26f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:03.913999 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f676-c9d1-4d3f-afb6-8ee66204d26f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:03.917485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:03.918088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:03.918368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:03.918644 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:03.927566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:03.929055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1bc2-3972-4e0e-be75-0b68b7dbb143 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:03.938833 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 486/965] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:03 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:08.356900 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4b39-397d-4c31-9192-5573845dcd78 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:08.357405 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4b39-397d-4c31-9192-5573845dcd78 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:08.359632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4b39-397d-4c31-9192-5573845dcd78 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:08.359632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 480/966] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:08.365276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ba43-52f6-4127-9739-be190e4498ce None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:08.365721 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ba43-52f6-4127-9739-be190e4498ce None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:08.365903 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ba43-52f6-4127-9739-be190e4498ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:08.385205 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e9d1ba43-52f6-4127-9739-be190e4498ce None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:08.386420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e9d1ba43-52f6-4127-9739-be190e4498ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:08.394836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 487/967] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:08.748222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756318-8b9b-4845-a019-c2295da3bd45 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:08.748574 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756318-8b9b-4845-a019-c2295da3bd45 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:08.748855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756318-8b9b-4845-a019-c2295da3bd45 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:08.750221 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 481/968] 10.222.0.91 () {54 vars in 965 bytes} [Tue Aug 23 23:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:08.757340 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f071b-9acc-4e1d-8e76-d4113fd3df03 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:08.757628 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f071b-9acc-4e1d-8e76-d4113fd3df03 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:08.759834 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f071b-9acc-4e1d-8e76-d4113fd3df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:08.791895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-531f071b-9acc-4e1d-8e76-d4113fd3df03 None None] MFA Rules not processed for user `ab7ee24711494e088ca175321680612f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:08.793202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-531f071b-9acc-4e1d-8e76-d4113fd3df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:08.800844 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 488/969] 10.222.0.91 () {58 vars in 1062 bytes} [Tue Aug 23 23:23:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:08.810071 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8756318-8b9b-4845-a019-c2295da3bd45 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:08.821572 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8756318-8b9b-4845-a019-c2295da3bd45 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:08.825171 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:08.825780 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:08.826060 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:08.826334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:08.836733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:08.838155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ec98f-8436-48a4-9296-642f9cd7862d service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:08.848313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 482/970] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:14.716400 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c0d3-5df1-4425-a5ce-d780a1054c5a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:14.716939 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c0d3-5df1-4425-a5ce-d780a1054c5a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:14.717235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c0d3-5df1-4425-a5ce-d780a1054c5a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:14.718995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 489/971] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:14.724831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887beb-3294-4999-aa6a-a8b106ef765e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:14.725686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887beb-3294-4999-aa6a-a8b106ef765e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:14.725686 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887beb-3294-4999-aa6a-a8b106ef765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:14.829470 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-68887beb-3294-4999-aa6a-a8b106ef765e None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:14.831688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-68887beb-3294-4999-aa6a-a8b106ef765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:14.916844 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 483/972] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:23:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:18.786907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=25 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:19.460720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd65394-db07-42a1-b5c5-5cc1d3205c95 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:19.460899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd65394-db07-42a1-b5c5-5cc1d3205c95 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:19.461261 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd65394-db07-42a1-b5c5-5cc1d3205c95 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:19.462562 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 490/973] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:19.468038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b727a-f2cb-4add-864a-5f0c03af96f2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:19.468596 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b727a-f2cb-4add-864a-5f0c03af96f2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:19.468787 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b727a-f2cb-4add-864a-5f0c03af96f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:19.490537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b77b727a-f2cb-4add-864a-5f0c03af96f2 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:19.491855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b77b727a-f2cb-4add-864a-5f0c03af96f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:19.501015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 484/974] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:23:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:21.000489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13299d30-e73e-4b72-9703-7711d707ac01 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:21.001024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13299d30-e73e-4b72-9703-7711d707ac01 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:21.001024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13299d30-e73e-4b72-9703-7711d707ac01 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:21.003274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 491/975] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:21.008148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b5d0-5fb7-4f4b-9c11-70469b8f38dc None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:21.008609 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b5d0-5fb7-4f4b-9c11-70469b8f38dc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:21.008737 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b5d0-5fb7-4f4b-9c11-70469b8f38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:21.029074 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-9844b5d0-5fb7-4f4b-9c11-70469b8f38dc None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:21.030311 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-9844b5d0-5fb7-4f4b-9c11-70469b8f38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:21.039472 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 485/976] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:23:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:24.991567 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efedc73-8178-4655-8ce4-a569d26d4260 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:24.992096 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efedc73-8178-4655-8ce4-a569d26d4260 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:24.993708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efedc73-8178-4655-8ce4-a569d26d4260 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:24.995184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 492/977] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:25.001672 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52405eb-c422-461a-8a27-1ac3e229cd4c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:25.002824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52405eb-c422-461a-8a27-1ac3e229cd4c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:25.003305 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52405eb-c422-461a-8a27-1ac3e229cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:25.023714 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=69 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:25.036597 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d52405eb-c422-461a-8a27-1ac3e229cd4c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:25.037928 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d52405eb-c422-461a-8a27-1ac3e229cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:25.046370 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 486/978] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:25.416497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63efba7-e4c4-4245-a137-fd2e66c0055b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:25.417172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63efba7-e4c4-4245-a137-fd2e66c0055b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:25.417694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63efba7-e4c4-4245-a137-fd2e66c0055b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:25.420505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 493/979] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 23 23:23:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:25.428628 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060642c2-69d6-4c69-8f56-14b3d42d2055 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:25.429615 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060642c2-69d6-4c69-8f56-14b3d42d2055 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:25.430243 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060642c2-69d6-4c69-8f56-14b3d42d2055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:25.487723 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-060642c2-69d6-4c69-8f56-14b3d42d2055 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:25.489092 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-060642c2-69d6-4c69-8f56-14b3d42d2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:25.568170 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 487/980] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 23 23:23:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:25.576496 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63efba7-e4c4-4245-a137-fd2e66c0055b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:25.592110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63efba7-e4c4-4245-a137-fd2e66c0055b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:25.598094 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:25.598703 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:25.598991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:25.599270 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:25.608047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:25.609681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec593-3c5f-4c12-82df-1b0528f0e134 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:25.624619 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 494/981] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:28.064694 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172dc81-c858-4a2c-ac91-398a453c9a5a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:28.065724 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172dc81-c858-4a2c-ac91-398a453c9a5a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:28.066039 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172dc81-c858-4a2c-ac91-398a453c9a5a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:28.067867 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 488/982] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:28.073006 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d456d-e766-4366-ac37-3276deb31fd2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:28.073453 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d456d-e766-4366-ac37-3276deb31fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:28.073569 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d456d-e766-4366-ac37-3276deb31fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:28.093654 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f26d456d-e766-4366-ac37-3276deb31fd2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:28.095182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f26d456d-e766-4366-ac37-3276deb31fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:28.103738 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 495/983] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:28.456246 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172dc81-c858-4a2c-ac91-398a453c9a5a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:28.470699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172dc81-c858-4a2c-ac91-398a453c9a5a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:28.476653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:28.477335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:28.477690 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:28.478043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:28.488407 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:28.490409 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad516f8-04eb-422f-adcc-8f41292ecb31 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:28.500997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 489/984] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:31.243687 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb6d8-e398-4759-991c-787f4dcaf854 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.244215 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb6d8-e398-4759-991c-787f4dcaf854 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.244313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb6d8-e398-4759-991c-787f4dcaf854 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.245664 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 496/985] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:31.250953 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76929c6-c570-4dc9-a7e9-9ea3e603ef45 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.251358 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76929c6-c570-4dc9-a7e9-9ea3e603ef45 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.251515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76929c6-c570-4dc9-a7e9-9ea3e603ef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.271456 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b76929c6-c570-4dc9-a7e9-9ea3e603ef45 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:31.272705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b76929c6-c570-4dc9-a7e9-9ea3e603ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:31.280972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 490/986] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:31.646671 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d68c-1dd2-467b-ba7b-0e20f9fff9fd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.647359 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d68c-1dd2-467b-ba7b-0e20f9fff9fd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.647657 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d68c-1dd2-467b-ba7b-0e20f9fff9fd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.650968 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 497/987] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 23 23:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:31.660458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a65bd-9e4f-4686-bfba-2e9edd00752a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.660773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a65bd-9e4f-4686-bfba-2e9edd00752a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.661074 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a65bd-9e4f-4686-bfba-2e9edd00752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.684124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-036a65bd-9e4f-4686-bfba-2e9edd00752a None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:31.685821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-036a65bd-9e4f-4686-bfba-2e9edd00752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:31.695581 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 491/988] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 23 23:23:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:31.710607 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653d68c-1dd2-467b-ba7b-0e20f9fff9fd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:31.726655 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653d68c-1dd2-467b-ba7b-0e20f9fff9fd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:31.731574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:31.732375 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.732902 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.733336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.744348 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:31.746172 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbc167-0bbc-4979-8949-4e799dddbbb1 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:31.757025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 498/989] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:34.291171 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee87-b388-4618-8996-404828f1730f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.292229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee87-b388-4618-8996-404828f1730f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.292705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee87-b388-4618-8996-404828f1730f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.300745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef787-4622-4996-98cf-9b5a8afe978b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.301592 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef787-4622-4996-98cf-9b5a8afe978b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.302331 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef787-4622-4996-98cf-9b5a8afe978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.305334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 492/990] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:34 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:34.325965 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-36aef787-4622-4996-98cf-9b5a8afe978b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:34.327461 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-36aef787-4622-4996-98cf-9b5a8afe978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:34.349270 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 499/991] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:34.714379 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68ee87-b388-4618-8996-404828f1730f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:34.730290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68ee87-b388-4618-8996-404828f1730f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:34.735713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:34.736688 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.737133 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.737564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.753378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:34.753378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070ea9-7f33-46b8-b609-5be650d623a1 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:34.774359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 493/992] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:35.488606 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a6d28-44d5-4230-a5b2-24cf1206c335 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:35.489032 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a6d28-44d5-4230-a5b2-24cf1206c335 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:35.489333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a6d28-44d5-4230-a5b2-24cf1206c335 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:35.490897 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 500/993] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:35.504011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028984fd-95de-4d60-8d8b-132fee9e10a4 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:35.504011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028984fd-95de-4d60-8d8b-132fee9e10a4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:35.504011 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028984fd-95de-4d60-8d8b-132fee9e10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:35.524974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-028984fd-95de-4d60-8d8b-132fee9e10a4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:35.524974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-028984fd-95de-4d60-8d8b-132fee9e10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:35.530233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 494/994] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:36.161880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9386-bb3c-4d90-80b0-fcc0c09bdf5d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:36.161880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9386-bb3c-4d90-80b0-fcc0c09bdf5d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:36.161880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9386-bb3c-4d90-80b0-fcc0c09bdf5d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:36.165155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 501/995] 10.222.0.91 () {54 vars in 964 bytes} [Tue Aug 23 23:23:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:36.170919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6059b-7b48-4c24-a438-0fab87b07543 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:36.171413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6059b-7b48-4c24-a438-0fab87b07543 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:36.171852 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6059b-7b48-4c24-a438-0fab87b07543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:36.238611 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-10f6059b-7b48-4c24-a438-0fab87b07543 None None] MFA Rules not processed for user `d0fb7270ef9444348b30a65938ede20a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:36.239986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-10f6059b-7b48-4c24-a438-0fab87b07543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:36.287270 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:36.304505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 495/996] 10.222.0.91 () {58 vars in 1061 bytes} [Tue Aug 23 23:23:36 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:36.312599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9386-bb3c-4d90-80b0-fcc0c09bdf5d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:36.323948 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9386-bb3c-4d90-80b0-fcc0c09bdf5d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:36.327739 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb7270ef9444348b30a65938ede20a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:36.328432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:36.328849 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:36.329336 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:36.339816 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:36.341425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7a693-cd55-4e09-a814-367ef20a32ab service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:36.352033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 502/997] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:37.305739 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b878-c49e-430b-a2f1-d54c9a8ec675 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:37.306896 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b878-c49e-430b-a2f1-d54c9a8ec675 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:37.307555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b878-c49e-430b-a2f1-d54c9a8ec675 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:37.311509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 496/998] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:37.315421 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10cbd-caf2-4556-8167-6899258c626e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:37.316525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10cbd-caf2-4556-8167-6899258c626e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:37.317060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10cbd-caf2-4556-8167-6899258c626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:37.346590 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-93a10cbd-caf2-4556-8167-6899258c626e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:37.347838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-93a10cbd-caf2-4556-8167-6899258c626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:37.356541 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 503/999] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:37.717359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b878-c49e-430b-a2f1-d54c9a8ec675 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:37.737577 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b878-c49e-430b-a2f1-d54c9a8ec675 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:37.745779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:37.746576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:37.747042 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:37.747464 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:37.757525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:37.759185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc2e49-a5bc-44d5-b729-25e9044d1ca4 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:37.770264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 497/1000] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:40.190238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b007ac-6dda-49a9-948e-6122dba04370 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:40.195368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b007ac-6dda-49a9-948e-6122dba04370 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:40.195655 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b007ac-6dda-49a9-948e-6122dba04370 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:40.197553 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 504/1001] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:40.205916 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cd65-b06e-45bb-a7fd-cf588020266e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:40.206367 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cd65-b06e-45bb-a7fd-cf588020266e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:40.206471 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960cd65-b06e-45bb-a7fd-cf588020266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:40.227675 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7960cd65-b06e-45bb-a7fd-cf588020266e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:40.230979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7960cd65-b06e-45bb-a7fd-cf588020266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:40.237644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 498/1002] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:40.610093 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b007ac-6dda-49a9-948e-6122dba04370 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:40.624263 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b007ac-6dda-49a9-948e-6122dba04370 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:40.629995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:40.630631 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:40.631009 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:40.631289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:40.640195 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:40.641827 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66cf1-883c-4d6d-a7fe-e8bc453a8b3b service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:40.654838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 505/1003] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:43.177649 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d69c8-d857-4799-93d8-1907ee25987b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:43.178219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d69c8-d857-4799-93d8-1907ee25987b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:43.178219 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d69c8-d857-4799-93d8-1907ee25987b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:43.179513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 499/1004] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:43.184923 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e57c4-fa90-4285-8e2a-9eb57cb8511b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:43.185345 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e57c4-fa90-4285-8e2a-9eb57cb8511b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:43.185455 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e57c4-fa90-4285-8e2a-9eb57cb8511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:43.205916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-929e57c4-fa90-4285-8e2a-9eb57cb8511b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:43.207126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-929e57c4-fa90-4285-8e2a-9eb57cb8511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:43.223072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 506/1005] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:43.567299 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d69c8-d857-4799-93d8-1907ee25987b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:43.582176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d69c8-d857-4799-93d8-1907ee25987b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:43.587469 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:43.588072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:43.588355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:43.588679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:43.597873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:43.599565 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecd7d4-4baa-4b0e-b608-1189521c154a service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:43.610315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 500/1006] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:45.846316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96ab7-0143-46be-bb7c-3e029691e7de None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:45.846897 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96ab7-0143-46be-bb7c-3e029691e7de None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:45.846897 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96ab7-0143-46be-bb7c-3e029691e7de None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:45.848295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 507/1007] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:45.854854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc2-1007-4523-a0b5-8e8f15fd4efd None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:45.855302 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc2-1007-4523-a0b5-8e8f15fd4efd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:45.855398 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58fc2-1007-4523-a0b5-8e8f15fd4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:45.874231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b2b58fc2-1007-4523-a0b5-8e8f15fd4efd None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:45.875476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b2b58fc2-1007-4523-a0b5-8e8f15fd4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:45.884276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 501/1008] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:46.257055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96ab7-0143-46be-bb7c-3e029691e7de None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:46.273882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96ab7-0143-46be-bb7c-3e029691e7de None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:46.280540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:46.281298 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:46.281633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:46.281985 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:46.295462 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:46.297283 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88a2c2-a004-4e95-9372-06fa53416b9b service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:46.312613 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 508/1009] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:50.414185 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d9ca-b528-41b6-820b-9d5d0220702f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:50.414816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d9ca-b528-41b6-820b-9d5d0220702f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:50.414986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d9ca-b528-41b6-820b-9d5d0220702f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:50.416770 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 502/1010] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:50.422579 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c851e-4855-44a2-a7e3-e3240a84cf47 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:50.423018 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c851e-4855-44a2-a7e3-e3240a84cf47 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:50.423287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c851e-4855-44a2-a7e3-e3240a84cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:50.432706 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=43 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:50.444819 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ea1c851e-4855-44a2-a7e3-e3240a84cf47 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:50.446113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ea1c851e-4855-44a2-a7e3-e3240a84cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:50.454214 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 509/1011] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:50.870695 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1d9ca-b528-41b6-820b-9d5d0220702f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:50.885475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1d9ca-b528-41b6-820b-9d5d0220702f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:50.890832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:50.891467 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:50.891791 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:50.892074 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:50.901225 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:50.902939 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c96fc-b99a-4306-be70-0dc77d87c012 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:50.913575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 503/1012] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:52.881122 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d6b6-7d35-4f0b-a867-faf2c37311f3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:52.881733 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d6b6-7d35-4f0b-a867-faf2c37311f3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:52.881733 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d6b6-7d35-4f0b-a867-faf2c37311f3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:52.883015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 510/1013] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:52.888425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94a9cd-8bb8-4a7a-8a90-d14275c37ffc None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:52.888891 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94a9cd-8bb8-4a7a-8a90-d14275c37ffc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:52.889000 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94a9cd-8bb8-4a7a-8a90-d14275c37ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:52.909704 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3e94a9cd-8bb8-4a7a-8a90-d14275c37ffc None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:52.911091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3e94a9cd-8bb8-4a7a-8a90-d14275c37ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:52.919192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 504/1014] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:53.279928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd971-daf0-4e4c-abd6-9752d022fe26 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.280246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd971-daf0-4e4c-abd6-9752d022fe26 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.280564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd971-daf0-4e4c-abd6-9752d022fe26 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.281927 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 511/1015] 10.222.0.91 () {54 vars in 967 bytes} [Tue Aug 23 23:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:53.287798 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.288089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.288365 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.326355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4207-96c1-4298-8a45-dbc1106f32b9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.326663 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4207-96c1-4298-8a45-dbc1106f32b9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.326904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4207-96c1-4298-8a45-dbc1106f32b9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.328227 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 512/1016] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:23:53.333752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.334039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.334322 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.344735 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] MFA Rules not processed for user `71640ebebcef490e9f3425f7559e3b57`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:53.346031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:53.353487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:53.354669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:53.363552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 513/1017] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:53.407251 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 505/1018] 10.222.0.91 () {58 vars in 1064 bytes} [Tue Aug 23 23:23:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:53.415347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:53.425416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7a5e-15ee-4d62-9e3a-2876df7f4b34 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:53.428991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71640ebebcef490e9f3425f7559e3b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:53.429594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.429882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.430161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.439445 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:53.441154 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b016d-7734-449b-b305-87dab94aabeb service glance] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:53.450570 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 514/1019] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:53.710304 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:53.722486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83649-8d56-4ce1-a86b-57b5c63b998d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:53.727451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:53.728057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.728344 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.728661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.737336 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:53.739084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d0b64-e0ea-48e2-b6ea-b2fc4f71a9d4 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:53.748520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 506/1020] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:56.227186 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c6b7-1f42-4591-909d-f566a1eafc2a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:56.228212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c6b7-1f42-4591-909d-f566a1eafc2a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:56.233187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c6b7-1f42-4591-909d-f566a1eafc2a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:56.234722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 515/1021] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:56.241427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144f89d-d7cd-4bc0-8236-96c41dc3eb5e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:56.241942 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144f89d-d7cd-4bc0-8236-96c41dc3eb5e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:56.241942 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144f89d-d7cd-4bc0-8236-96c41dc3eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:56.264733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e144f89d-d7cd-4bc0-8236-96c41dc3eb5e None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:56.265953 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e144f89d-d7cd-4bc0-8236-96c41dc3eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:56.274247 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 507/1022] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:56.630624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c6b7-1f42-4591-909d-f566a1eafc2a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:56.649491 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c6b7-1f42-4591-909d-f566a1eafc2a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:56.654612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:56.658799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:56.658799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:56.658799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:56.670005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:56.671646 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f9df-b0ce-4aa4-bdf1-f39bfc8a7b04 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:56.686511 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 516/1023] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:59.128562 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d2f9-1bda-4356-837f-d5b071bb82b7 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:59.129232 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d2f9-1bda-4356-837f-d5b071bb82b7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:59.129232 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5d2f9-1bda-4356-837f-d5b071bb82b7 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:59.130482 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 508/1024] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:59.135957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1448-e549-4bcb-82ba-846459d6dc6c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:59.136493 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1448-e549-4bcb-82ba-846459d6dc6c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:59.136625 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1448-e549-4bcb-82ba-846459d6dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:59.156878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-60be1448-e549-4bcb-82ba-846459d6dc6c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:59.158106 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-60be1448-e549-4bcb-82ba-846459d6dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:59.167750 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 517/1025] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:59.522229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d2f9-1bda-4356-837f-d5b071bb82b7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:59.537552 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5d2f9-1bda-4356-837f-d5b071bb82b7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:59.543680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:59.543680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:59.543921 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:59.544187 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:59.553105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:59.554692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c05c4-33c5-4788-b72d-3f4936f27b08 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:59.565665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 509/1026] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:09.151856 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=20 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:09.526732 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581793-62ad-49b8-82fe-8e132def54e9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:09.526937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581793-62ad-49b8-82fe-8e132def54e9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:09.527197 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581793-62ad-49b8-82fe-8e132def54e9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.529108 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 518/1027] 10.222.0.91 () {54 vars in 918 bytes} [Tue Aug 23 23:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:09.534135 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1efc7-ffdc-4bc6-92a9-ce83442aa351 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:09.534638 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1efc7-ffdc-4bc6-92a9-ce83442aa351 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:09.534747 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1efc7-ffdc-4bc6-92a9-ce83442aa351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.542278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=86 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:09.554480 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b8e1efc7-ffdc-4bc6-92a9-ce83442aa351 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:09.562811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b8e1efc7-ffdc-4bc6-92a9-ce83442aa351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:09.564091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 510/1028] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Aug 23 23:24:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:09.578571 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204e78-a085-44c3-b041-2b489ef3b350 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:09.578864 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204e78-a085-44c3-b041-2b489ef3b350 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:09.579146 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204e78-a085-44c3-b041-2b489ef3b350 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.580464 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 519/1029] 10.222.0.91 () {54 vars in 918 bytes} [Tue Aug 23 23:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:09.585135 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d6b-1fe5-4f27-80ec-bc3b19be93f2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:09.585425 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d6b-1fe5-4f27-80ec-bc3b19be93f2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:09.585704 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d6b-1fe5-4f27-80ec-bc3b19be93f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.605515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-fb2b9d6b-1fe5-4f27-80ec-bc3b19be93f2 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:09.606731 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-fb2b9d6b-1fe5-4f27-80ec-bc3b19be93f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:09.615935 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 511/1030] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Aug 23 23:24:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:12.341480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6140e-7ac7-4876-90e3-5876341b9186 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:12.342022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6140e-7ac7-4876-90e3-5876341b9186 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:12.342022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6140e-7ac7-4876-90e3-5876341b9186 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:12.343274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 520/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:12.348979 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642de4-7266-4320-9db2-9bf621eb67f1 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:12.349411 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642de4-7266-4320-9db2-9bf621eb67f1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:12.349519 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642de4-7266-4320-9db2-9bf621eb67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:12.368878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ea642de4-7266-4320-9db2-9bf621eb67f1 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:12.370076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ea642de4-7266-4320-9db2-9bf621eb67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:12.378560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 512/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:12.725827 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6140e-7ac7-4876-90e3-5876341b9186 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:12.739994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6140e-7ac7-4876-90e3-5876341b9186 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:12.744971 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:12.745563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:12.745844 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:12.746120 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:12.754388 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:12.755976 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c559f1-bade-42cc-9c7c-dfc89c894434 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:12.765170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 521/1033] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:13.740065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601695-62a4-4b95-a872-0ace77f5cf89 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:13.740677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601695-62a4-4b95-a872-0ace77f5cf89 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:13.740677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601695-62a4-4b95-a872-0ace77f5cf89 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:13.742010 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 513/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:13.746980 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c646e-24e6-4f53-a9f4-90ee15bb99ae None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:13.750254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c646e-24e6-4f53-a9f4-90ee15bb99ae None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:13.750254 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c646e-24e6-4f53-a9f4-90ee15bb99ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:13.768301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-034c646e-24e6-4f53-a9f4-90ee15bb99ae None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:13.769624 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-034c646e-24e6-4f53-a9f4-90ee15bb99ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:13.777751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 522/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:13.986855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601695-62a4-4b95-a872-0ace77f5cf89 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:14.000576 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601695-62a4-4b95-a872-0ace77f5cf89 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:14.006434 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:14.007072 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:14.007331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:14.007600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:14.015674 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:14.017454 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984113cc-5f93-46a5-975a-fc8b2052dadb service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:14.027189 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 514/1036] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:14.926272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9de9f-f6bc-4244-bee6-5ab00558ea36 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:14.926873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9de9f-f6bc-4244-bee6-5ab00558ea36 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:14.926873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9de9f-f6bc-4244-bee6-5ab00558ea36 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:14.928189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 523/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:14.933113 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b783aa-1845-430b-b1d8-a398905e79ad None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:14.933509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b783aa-1845-430b-b1d8-a398905e79ad None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:14.933656 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b783aa-1845-430b-b1d8-a398905e79ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:14.952606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-87b783aa-1845-430b-b1d8-a398905e79ad None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:14.953803 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-87b783aa-1845-430b-b1d8-a398905e79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:14.961582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 515/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:15.120027 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9de9f-f6bc-4244-bee6-5ab00558ea36 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:15.133680 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9de9f-f6bc-4244-bee6-5ab00558ea36 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:15.138882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:15.139480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:15.139766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:15.140042 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:15.148552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:15.150159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74f14-65ab-4e52-91f6-d7eb1477a5e3 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:15.160609 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 524/1039] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:16.031740 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740bfa4-76fe-491d-8b32-a244f7f3cf73 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:16.032288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740bfa4-76fe-491d-8b32-a244f7f3cf73 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:16.032288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740bfa4-76fe-491d-8b32-a244f7f3cf73 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:16.033699 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 516/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:16.038524 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade995-ad45-405b-810e-cad8c8e9f1b4 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:16.039022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade995-ad45-405b-810e-cad8c8e9f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:16.039139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade995-ad45-405b-810e-cad8c8e9f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:16.058639 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d5ade995-ad45-405b-810e-cad8c8e9f1b4 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:16.059849 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d5ade995-ad45-405b-810e-cad8c8e9f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:16.068531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 525/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:16.224495 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740bfa4-76fe-491d-8b32-a244f7f3cf73 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:16.238349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740bfa4-76fe-491d-8b32-a244f7f3cf73 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:16.243214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:16.243805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:16.244084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:16.244355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:16.252716 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:16.254287 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316f13-55b4-452b-8fcd-84b72cfc466a service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:16.263678 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 517/1042] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:17.145574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57d1b-f30e-4c8e-be5a-50c2abe5249d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:17.146156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57d1b-f30e-4c8e-be5a-50c2abe5249d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:17.146156 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57d1b-f30e-4c8e-be5a-50c2abe5249d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:17.147431 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 526/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:17.152530 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aee44-9a8c-42cf-8c00-0e1c4db0b059 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:17.152986 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aee44-9a8c-42cf-8c00-0e1c4db0b059 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:17.153101 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aee44-9a8c-42cf-8c00-0e1c4db0b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:17.172293 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-856aee44-9a8c-42cf-8c00-0e1c4db0b059 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:17.174217 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-856aee44-9a8c-42cf-8c00-0e1c4db0b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:17.182592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 518/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:17.337290 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae57d1b-f30e-4c8e-be5a-50c2abe5249d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:17.351512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae57d1b-f30e-4c8e-be5a-50c2abe5249d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:17.356522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:17.357114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:17.357422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:17.357697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:17.366378 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:17.367961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c8050-458e-4e4d-96ae-4f2cd755ad8f service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:17.377456 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 527/1045] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:18.257327 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e01f-deb0-4230-86bc-6703dff85468 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:18.257812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e01f-deb0-4230-86bc-6703dff85468 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:18.257925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e01f-deb0-4230-86bc-6703dff85468 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:18.259202 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 519/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:18.264075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be166-5286-46da-ba65-e7555d5f267a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:18.264543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be166-5286-46da-ba65-e7555d5f267a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:18.264685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be166-5286-46da-ba65-e7555d5f267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:18.285077 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-376be166-5286-46da-ba65-e7555d5f267a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:18.286295 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-376be166-5286-46da-ba65-e7555d5f267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:18.294238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 528/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:18.449636 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e01f-deb0-4230-86bc-6703dff85468 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:18.463269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e01f-deb0-4230-86bc-6703dff85468 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:18.468116 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:18.468740 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:18.469015 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:18.469285 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:18.478002 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:18.479553 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78da68-81f5-43f8-ab4f-2ec58a6b28a8 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:18.488784 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 520/1048] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:19.358488 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73a2db-c79e-4065-88ef-9ff44458908f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.359025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73a2db-c79e-4065-88ef-9ff44458908f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.359025 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73a2db-c79e-4065-88ef-9ff44458908f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.360450 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 529/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:19.365945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da82df-b2f8-4b9c-a4f7-1feeec942132 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.366380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da82df-b2f8-4b9c-a4f7-1feeec942132 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.366488 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da82df-b2f8-4b9c-a4f7-1feeec942132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.386549 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-46da82df-b2f8-4b9c-a4f7-1feeec942132 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:19.387759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-46da82df-b2f8-4b9c-a4f7-1feeec942132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:19.395646 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 521/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:19.554059 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73a2db-c79e-4065-88ef-9ff44458908f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:19.567476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73a2db-c79e-4065-88ef-9ff44458908f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:19.572341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:19.572977 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.573257 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.573527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.581852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:19.583418 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af222a-f222-44b8-bb0e-e5f812b04122 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:19.592568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 530/1051] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:20.476278 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f32f-da04-48b2-b12b-1964601c5c2e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.476846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f32f-da04-48b2-b12b-1964601c5c2e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.476846 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f32f-da04-48b2-b12b-1964601c5c2e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.478122 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 522/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:20.482913 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5b77-60d1-45b3-b921-73423a18f4ad None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.483324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5b77-60d1-45b3-b921-73423a18f4ad None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.483469 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5b77-60d1-45b3-b921-73423a18f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.503097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0d2f5b77-60d1-45b3-b921-73423a18f4ad None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:20.504306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0d2f5b77-60d1-45b3-b921-73423a18f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.512097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 531/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:20.670324 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f32f-da04-48b2-b12b-1964601c5c2e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:20.684355 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f32f-da04-48b2-b12b-1964601c5c2e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:20.690097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:20.690682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.690966 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.691240 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.699371 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:20.700972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c2d17-8383-4f66-b92a-cf3b745e9c5a service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:20.710434 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 523/1054] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:21.624162 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273b07-178c-44c5-8e1f-89005ebeb8ba None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:21.624782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273b07-178c-44c5-8e1f-89005ebeb8ba None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:21.624782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273b07-178c-44c5-8e1f-89005ebeb8ba None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:21.625998 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 532/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:21.631823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b2c6-2f16-4032-9f26-ef0ebb956a6c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:21.639789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b2c6-2f16-4032-9f26-ef0ebb956a6c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:21.639789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b2c6-2f16-4032-9f26-ef0ebb956a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:21.652589 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-fd03b2c6-2f16-4032-9f26-ef0ebb956a6c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:21.653820 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-fd03b2c6-2f16-4032-9f26-ef0ebb956a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:21.662358 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 524/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:24:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:21.816981 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a273b07-178c-44c5-8e1f-89005ebeb8ba None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:21.831247 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a273b07-178c-44c5-8e1f-89005ebeb8ba None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:21.836167 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:21.836795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:21.837079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:21.837351 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:21.846105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:21.847672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0daba-d2d6-4e35-ba9c-2bac51a2c0eb service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:21.856988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 533/1057] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:23.920057 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094ba4-fbf8-4922-8bd4-75f7f44ae982 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:23.920600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094ba4-fbf8-4922-8bd4-75f7f44ae982 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:23.920600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094ba4-fbf8-4922-8bd4-75f7f44ae982 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:23.922035 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 525/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:23.928088 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac382-3962-4d17-93ef-5980443ce56b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:23.928572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac382-3962-4d17-93ef-5980443ce56b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:23.928858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac382-3962-4d17-93ef-5980443ce56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:23.947777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b19ac382-3962-4d17-93ef-5980443ce56b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:23.949022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b19ac382-3962-4d17-93ef-5980443ce56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:23.957342 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 534/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:24.316540 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094ba4-fbf8-4922-8bd4-75f7f44ae982 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:24.327594 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094ba4-fbf8-4922-8bd4-75f7f44ae982 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:24.335349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:24.335349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:24.335349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:24.335349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:24.342204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:24.343632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5a8a4-272c-45d1-a9b7-2861f0a7fdf9 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:24.353841 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 526/1060] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:26.729491 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d9cc-9758-4dad-9390-545faa8a2ad3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:26.730074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d9cc-9758-4dad-9390-545faa8a2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:26.730178 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d9cc-9758-4dad-9390-545faa8a2ad3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:26.731755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 535/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:26.738186 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a288a6-a53a-4a30-8f45-ed130759e069 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:26.738744 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a288a6-a53a-4a30-8f45-ed130759e069 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:26.738744 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a288a6-a53a-4a30-8f45-ed130759e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:26.763048 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-27a288a6-a53a-4a30-8f45-ed130759e069 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:26.764286 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-27a288a6-a53a-4a30-8f45-ed130759e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:26.773184 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 527/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:27.117449 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d9cc-9758-4dad-9390-545faa8a2ad3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:27.128871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d9cc-9758-4dad-9390-545faa8a2ad3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:27.133956 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:27.134579 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:27.134865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:27.135145 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:27.145380 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:27.146823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed22e6-7c30-4023-9258-9e3bc19c34f5 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:27.156778 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 536/1063] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:29.707897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ac597-8fa2-46c2-b3cc-2a702d655555 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:29.708502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ac597-8fa2-46c2-b3cc-2a702d655555 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:29.708502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ac597-8fa2-46c2-b3cc-2a702d655555 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:29.709823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 528/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:29.715069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90a13-6316-4bf2-9f27-225eebf5b3ec None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:29.715540 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90a13-6316-4bf2-9f27-225eebf5b3ec None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:29.715652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90a13-6316-4bf2-9f27-225eebf5b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:29.735012 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f3f90a13-6316-4bf2-9f27-225eebf5b3ec None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:29.736235 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f3f90a13-6316-4bf2-9f27-225eebf5b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:29.744272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 537/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:30.088148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ac597-8fa2-46c2-b3cc-2a702d655555 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:30.099357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ac597-8fa2-46c2-b3cc-2a702d655555 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:30.102878 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:30.103469 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:30.103750 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:30.104022 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:30.114250 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:30.115692 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b219d3-0965-400d-99d9-c82444b84daa service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:30.125040 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 529/1066] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:32.452407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970fa6-dce1-4d98-a048-eac29ba32ae8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.453010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970fa6-dce1-4d98-a048-eac29ba32ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.453113 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970fa6-dce1-4d98-a048-eac29ba32ae8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.455183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 538/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:32.460429 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83fb9-75a0-4620-8c7c-a4cb7e99f0d6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.460864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83fb9-75a0-4620-8c7c-a4cb7e99f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.461012 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83fb9-75a0-4620-8c7c-a4cb7e99f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.480998 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-72b83fb9-75a0-4620-8c7c-a4cb7e99f0d6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:32.482147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-72b83fb9-75a0-4620-8c7c-a4cb7e99f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:32.490222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 530/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:32.832236 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00970fa6-dce1-4d98-a048-eac29ba32ae8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:32.842890 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00970fa6-dce1-4d98-a048-eac29ba32ae8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:32.846367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:32.846957 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.847238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.847530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.856105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:32.857571 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bd7df-e644-47d8-a41f-161e9d14e5e1 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:32.867511 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 539/1069] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:35.107245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5dd7-0195-4e2a-b055-d2e624ef129c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:35.107874 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5dd7-0195-4e2a-b055-d2e624ef129c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:35.107874 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5dd7-0195-4e2a-b055-d2e624ef129c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:35.109315 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 531/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:35.115616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477112eb-8a09-4aff-b525-4029a5ccf899 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:35.116115 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477112eb-8a09-4aff-b525-4029a5ccf899 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:35.116211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477112eb-8a09-4aff-b525-4029a5ccf899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:35.135761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-477112eb-8a09-4aff-b525-4029a5ccf899 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:35.137011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-477112eb-8a09-4aff-b525-4029a5ccf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:35.144825 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 540/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:35.486458 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5dd7-0195-4e2a-b055-d2e624ef129c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:35.497383 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5dd7-0195-4e2a-b055-d2e624ef129c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:35.500945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:35.502148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:35.502426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:35.502698 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:35.511575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:35.513031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1328cfa-4f2e-4410-a5c3-e7d4b6e7152a service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:35.523348 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 532/1072] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:37.791959 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98820-f736-41a3-853b-bbe62cb380fb None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:37.792568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98820-f736-41a3-853b-bbe62cb380fb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:37.792568 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98820-f736-41a3-853b-bbe62cb380fb None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:37.793880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 541/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:24:37.799089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fe68-b93e-46b8-aa97-83ffb3eb9ade None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:37.799545 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fe68-b93e-46b8-aa97-83ffb3eb9ade None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:37.799645 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fe68-b93e-46b8-aa97-83ffb3eb9ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:37.818677 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a3a9fe68-b93e-46b8-aa97-83ffb3eb9ade None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:37.819900 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a3a9fe68-b93e-46b8-aa97-83ffb3eb9ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:37.827732 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 533/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:38.179014 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa98820-f736-41a3-853b-bbe62cb380fb None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:38.189986 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa98820-f736-41a3-853b-bbe62cb380fb None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:38.193600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:38.194193 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.194480 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.194756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.203566 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:38.205072 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ce78b-c962-4335-b227-30755b57a566 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:38.214531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 542/1075] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:40.458045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0644d5-d9ab-469b-8472-01c6001093ce None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:40.458607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0644d5-d9ab-469b-8472-01c6001093ce None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:40.458607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0644d5-d9ab-469b-8472-01c6001093ce None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:40.459978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 534/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:40.465232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7e276-caff-4d6f-b7fc-006dcd11e172 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:40.465622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7e276-caff-4d6f-b7fc-006dcd11e172 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:40.465791 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7e276-caff-4d6f-b7fc-006dcd11e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:40.473799 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=70 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:40.486861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b8e7e276-caff-4d6f-b7fc-006dcd11e172 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:40.488073 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b8e7e276-caff-4d6f-b7fc-006dcd11e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:40.495876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 543/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:40.839598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0644d5-d9ab-469b-8472-01c6001093ce None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:40.845238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=72 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:40.850812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0644d5-d9ab-469b-8472-01c6001093ce None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:40.854566 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:40.872200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:40.872200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:40.872200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:40.872200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:40.872200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e429f8-5807-4d0c-bb62-a5d41d67aee3 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:40.875746 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 535/1078] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:43.086784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f833d8-20ac-4e8b-93b1-14cf592881d3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.087330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f833d8-20ac-4e8b-93b1-14cf592881d3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.087330 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f833d8-20ac-4e8b-93b1-14cf592881d3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.088693 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 544/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:43.094368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18221-db95-499a-a9f7-203425a2f705 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.094805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18221-db95-499a-a9f7-203425a2f705 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.095086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18221-db95-499a-a9f7-203425a2f705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.115231 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-75e18221-db95-499a-a9f7-203425a2f705 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:43.116476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-75e18221-db95-499a-a9f7-203425a2f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:43.124288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 536/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:43.476310 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f833d8-20ac-4e8b-93b1-14cf592881d3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:43.487548 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f833d8-20ac-4e8b-93b1-14cf592881d3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:43.491003 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:43.491591 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.491870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.492139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.501277 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:43.502740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69e20-c260-4bee-a1dc-490c1a190296 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:43.513950 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 545/1081] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:45.769045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057302a-da8b-4afc-952b-a988cbc83dc9 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:45.769622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057302a-da8b-4afc-952b-a988cbc83dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:45.769622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057302a-da8b-4afc-952b-a988cbc83dc9 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:45.770944 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 537/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:45.776600 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faf1-310f-48cd-afb8-a2d0a8a2c9b5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:45.777002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faf1-310f-48cd-afb8-a2d0a8a2c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:45.777160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faf1-310f-48cd-afb8-a2d0a8a2c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:45.796407 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f5e9faf1-310f-48cd-afb8-a2d0a8a2c9b5 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:45.798273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f5e9faf1-310f-48cd-afb8-a2d0a8a2c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:45.806094 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 546/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:46.148650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057302a-da8b-4afc-952b-a988cbc83dc9 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:46.160193 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057302a-da8b-4afc-952b-a988cbc83dc9 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:46.163843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:46.164468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:46.164754 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:46.165034 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:46.174153 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:46.175600 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a5ccf-fae5-4d4e-b989-ac357832d644 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:46.184948 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 538/1084] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:48.371714 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2dfb-5d87-485c-b486-1b0437594078 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:48.372250 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2dfb-5d87-485c-b486-1b0437594078 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:48.372352 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2dfb-5d87-485c-b486-1b0437594078 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:48.373665 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 547/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:48.378848 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f4f0-7a50-411c-9485-ca2cefabd12c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:48.379246 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f4f0-7a50-411c-9485-ca2cefabd12c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:48.379402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f4f0-7a50-411c-9485-ca2cefabd12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:48.398834 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c8e3f4f0-7a50-411c-9485-ca2cefabd12c None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:48.400019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c8e3f4f0-7a50-411c-9485-ca2cefabd12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:48.408789 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 539/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:48.749447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b2dfb-5d87-485c-b486-1b0437594078 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:48.761307 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b2dfb-5d87-485c-b486-1b0437594078 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:48.764874 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:48.765473 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:48.765757 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:48.766033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:48.775937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:48.777414 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e738db-4c02-426a-b845-2b1cc3d8f0bd service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:48.787062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 548/1087] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:58.394214 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=17 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:58.782774 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=17 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:13.734065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9594e-f516-4ea9-b784-e92240a11d75 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:13.734640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9594e-f516-4ea9-b784-e92240a11d75 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:13.734640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9594e-f516-4ea9-b784-e92240a11d75 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:13.735957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 540/1088] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:13.741273 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1c98-fbb9-4082-8959-f43cc6e2f028 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:13.741708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1c98-fbb9-4082-8959-f43cc6e2f028 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:13.741837 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1c98-fbb9-4082-8959-f43cc6e2f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:13.761287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-673c1c98-fbb9-4082-8959-f43cc6e2f028 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:13.762499 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-673c1c98-fbb9-4082-8959-f43cc6e2f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:13.771155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 549/1089] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:14.128295 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976942a-c961-480f-9928-3af44f1a54d0 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:14.128613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976942a-c961-480f-9928-3af44f1a54d0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:14.128892 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976942a-c961-480f-9928-3af44f1a54d0 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:14.130207 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 541/1090] 10.222.0.91 () {54 vars in 967 bytes} [Tue Aug 23 23:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:14.135389 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05d96-af69-4b30-9b10-c77a7f49f4a3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:14.135682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05d96-af69-4b30-9b10-c77a7f49f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:14.135965 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05d96-af69-4b30-9b10-c77a7f49f4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:14.155341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b2a05d96-af69-4b30-9b10-c77a7f49f4a3 None None] MFA Rules not processed for user `71640ebebcef490e9f3425f7559e3b57`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:14.157091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b2a05d96-af69-4b30-9b10-c77a7f49f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:14.163521 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 550/1091] 10.222.0.91 () {58 vars in 1064 bytes} [Tue Aug 23 23:25:14 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:14.170640 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976942a-c961-480f-9928-3af44f1a54d0 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:14.181887 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976942a-c961-480f-9928-3af44f1a54d0 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:14.185416 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71640ebebcef490e9f3425f7559e3b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:14.186001 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:14.186310 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:14.186613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:14.195623 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:14.197099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34631-c10b-4fd8-80ce-9f799237fc76 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:14.206601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 542/1092] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:16.486092 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b629-1979-410a-b0e6-326c16c27414 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:16.486630 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b629-1979-410a-b0e6-326c16c27414 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:16.486630 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091b629-1979-410a-b0e6-326c16c27414 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:16.487905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 551/1093] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:16.493229 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3450c7-26b9-4aa5-92f2-29e503c2ab8a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:16.493614 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3450c7-26b9-4aa5-92f2-29e503c2ab8a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:16.493782 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3450c7-26b9-4aa5-92f2-29e503c2ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:16.513601 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-dc3450c7-26b9-4aa5-92f2-29e503c2ab8a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:16.516038 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-dc3450c7-26b9-4aa5-92f2-29e503c2ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:16.523759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 543/1094] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:16.849784 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091b629-1979-410a-b0e6-326c16c27414 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:16.863184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091b629-1979-410a-b0e6-326c16c27414 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:16.867653 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:16.868242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:16.868558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:16.868835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:16.869472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:16.871212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:25:16.871212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:25:16.871212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:25:16.872353 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaf602-93b2-458e-9a45-0d6cbcf0f11c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:16.890836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 552/1095] 10.222.0.91 () {56 vars in 1108 bytes} [Tue Aug 23 23:25:16 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:25:19.075890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca7d-0d27-4fa5-b29e-1ccb946cd18f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:19.076504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca7d-0d27-4fa5-b29e-1ccb946cd18f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:19.076504 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca7d-0d27-4fa5-b29e-1ccb946cd18f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:19.078536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 544/1096] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:25:19.083685 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69d87-e433-4ec8-8747-daeb7f3e3e61 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:19.084105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69d87-e433-4ec8-8747-daeb7f3e3e61 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:19.084304 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69d87-e433-4ec8-8747-daeb7f3e3e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:19.103930 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6ba69d87-e433-4ec8-8747-daeb7f3e3e61 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:19.105187 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6ba69d87-e433-4ec8-8747-daeb7f3e3e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:19.113249 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 553/1097] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:19.467879 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ca7d-0d27-4fa5-b29e-1ccb946cd18f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:19.481291 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ca7d-0d27-4fa5-b29e-1ccb946cd18f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:19.486669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:19.487279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:19.487559 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:19.487832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:19.496505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:19.498076 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310286-9ac3-4217-a2b6-3c0d34d0ad74 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:19.508162 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 545/1098] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:21.869560 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03a73-cc55-40d2-98a4-888f8baedcb7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:21.870158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03a73-cc55-40d2-98a4-888f8baedcb7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:21.870158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03a73-cc55-40d2-98a4-888f8baedcb7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:21.871484 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 554/1099] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:21.877416 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076874b-0ecd-43ca-89ca-06e874c1bca6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:21.877855 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076874b-0ecd-43ca-89ca-06e874c1bca6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:21.877961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076874b-0ecd-43ca-89ca-06e874c1bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:21.898322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-6076874b-0ecd-43ca-89ca-06e874c1bca6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:21.899520 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-6076874b-0ecd-43ca-89ca-06e874c1bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:21.907394 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 546/1100] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:22.248301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03a73-cc55-40d2-98a4-888f8baedcb7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:22.260048 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03a73-cc55-40d2-98a4-888f8baedcb7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:22.263567 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:22.264161 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:22.264465 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:22.264761 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:22.274033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:22.275472 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ea25-891e-4556-a2ee-f1194decb5ed service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:22.284793 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 555/1101] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:24.558961 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2044-8cd3-4eaf-b02c-65a148356e3c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:24.559525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2044-8cd3-4eaf-b02c-65a148356e3c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:24.559525 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f2044-8cd3-4eaf-b02c-65a148356e3c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:24.560792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 547/1102] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:24.567051 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4d9d-782c-4999-a01d-c22ab55f450b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:24.567507 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4d9d-782c-4999-a01d-c22ab55f450b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:24.567616 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4d9d-782c-4999-a01d-c22ab55f450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:24.586398 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-185b4d9d-782c-4999-a01d-c22ab55f450b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:24.587604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-185b4d9d-782c-4999-a01d-c22ab55f450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:24.595610 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 556/1103] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:24.945091 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f2044-8cd3-4eaf-b02c-65a148356e3c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:24.955864 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f2044-8cd3-4eaf-b02c-65a148356e3c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:24.959357 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:24.959982 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:24.960265 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:24.960583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:24.969965 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:24.971389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aa6fa-9b80-4dab-88d0-e08d37023d78 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:24.980734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 548/1104] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:27.431327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734c4f4-bf9d-4da4-bac7-55c2e2962445 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.431875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734c4f4-bf9d-4da4-bac7-55c2e2962445 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.431875 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734c4f4-bf9d-4da4-bac7-55c2e2962445 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.433316 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 557/1105] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:27.438823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b58c-7aca-4616-a2b7-033b9c10b86d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.439276 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b58c-7aca-4616-a2b7-033b9c10b86d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.439417 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b58c-7aca-4616-a2b7-033b9c10b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.458888 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-baf1b58c-7aca-4616-a2b7-033b9c10b86d None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:27.460141 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-baf1b58c-7aca-4616-a2b7-033b9c10b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:27.469496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 549/1106] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:27.819838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734c4f4-bf9d-4da4-bac7-55c2e2962445 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:27.831152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734c4f4-bf9d-4da4-bac7-55c2e2962445 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:27.834621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:27.835211 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.835495 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.835771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.844652 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:27.846064 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fede69-27b6-46e5-8e3c-d7c22f54a62e service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:27.855372 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 558/1107] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:30.490272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339177b-ba37-4f08-9427-968a907bc301 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:30.490812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339177b-ba37-4f08-9427-968a907bc301 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:30.490812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339177b-ba37-4f08-9427-968a907bc301 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:30.492099 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 550/1108] 10.222.0.91 () {54 vars in 927 bytes} [Tue Aug 23 23:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:30.497166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc395b-8dbe-4cff-a3c2-2d4a54dd1d7f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:30.497612 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc395b-8dbe-4cff-a3c2-2d4a54dd1d7f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:30.497723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc395b-8dbe-4cff-a3c2-2d4a54dd1d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:30.517751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-42bc395b-8dbe-4cff-a3c2-2d4a54dd1d7f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:30.519029 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-42bc395b-8dbe-4cff-a3c2-2d4a54dd1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:30.527637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 559/1109] 10.222.0.91 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:30.875283 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339177b-ba37-4f08-9427-968a907bc301 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:30.886158 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339177b-ba37-4f08-9427-968a907bc301 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:30.889687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:30.890286 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:30.890564 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:30.890849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:30.899885 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:30.901451 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da182ff-9c96-43cd-b88e-63282d738e48 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:30.911424 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 551/1110] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:25:40.512535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=33 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:40.907359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=33 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:54.779621 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:54.780246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:54.780246 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:54.800112 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:54.801344 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:54.809007 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 560/1111] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:26:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:54.817178 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:54.817687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:54.817687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:54.836903 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:54.838088 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:54.846320 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 552/1112] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:26:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:54.850896 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:54.860667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ded65-4c5a-4ef8-949a-401eb4ebaff9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:54.865203 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:54.865795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:54.866078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:54.866352 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:54.867019 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:26:54.867324 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:54.868355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:54.868355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:26:54.868355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:26:54.869271 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:54.881300 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 561/1113] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 23 23:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:26:54.889246 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:54.899147 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e14b-5572-4e33-b09f-ece78bfe1701 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:54.903828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:54.904426 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:54.904733 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:54.905006 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:54.905659 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:54.908166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:54.908166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:26:54.908166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:26:54.909403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.025329 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 553/1114] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 23 23:26:54 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:26:55.028828 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.040008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f71efc-e8b3-49f4-a30b-3c98cdf6a2d2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.098445 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.099047 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.099333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.099611 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.100245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.101319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:55.101319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:26:55.101319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:26:55.102634 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.177873 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 562/1115] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:26:55 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:26:55.182318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.193898 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22e0d-ff78-45bb-a175-c0973d8926ea admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.198823 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.199637 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.199943 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.200351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.201089 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.202137 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:55.202137 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:26:55.202137 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:26:55.203661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.220275 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 554/1116] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:26:55.221645 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.232158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948157-37df-4015-9c12-7addc4e7c697 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.237272 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.237879 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.238160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.238433 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.239075 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.240258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:55.240258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:26:55.240258 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:26:55.241165 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05492fea-5aba-412f-9407-81122f8ea307 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.255394 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 563/1117] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:26:55.259661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.270204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f3cab-86b5-4e19-92ee-266ac8e76ac9 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.274990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.275666 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.275949 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.276226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] PATH_INFO: `/v3/projects/91b7490ce368447fb6cb7c0b863d17a6/users/569ea1df2a75450c95e755dd72e43a6f/roles/686d6006762640dba07b0fb12570a686` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.290866 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b7490ce368447fb6cb7c0b863d17a6, user_id=569ea1df2a75450c95e755dd72e43a6f, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.291831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:55.291831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:26:55.291831 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:26:55.293821 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcae075-26d3-4caf-bf23-81eeb1310c52 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.396199 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 555/1118] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:26:55 2022] PUT /identity/v3/projects/91b7490ce368447fb6cb7c0b863d17a6/users/569ea1df2a75450c95e755dd72e43a6f/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:55.408950 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4702b2-622b-4bf8-bed3-46a6e15c48d6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.409262 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4702b2-622b-4bf8-bed3-46a6e15c48d6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.409537 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4702b2-622b-4bf8-bed3-46a6e15c48d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.438279 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1a4702b2-622b-4bf8-bed3-46a6e15c48d6 None None] MFA Rules not processed for user `569ea1df2a75450c95e755dd72e43a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:55.439542 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1a4702b2-622b-4bf8-bed3-46a6e15c48d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:55.507148 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 564/1119] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:26:55 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:55.520620 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc945e-6e52-4719-862d-87877dec13fc None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.520913 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc945e-6e52-4719-862d-87877dec13fc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.521190 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc945e-6e52-4719-862d-87877dec13fc None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.522762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 556/1120] 10.222.0.91 () {54 vars in 964 bytes} [Tue Aug 23 23:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:55.527399 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4227-8598-4eab-baea-9df32152063b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.527681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4227-8598-4eab-baea-9df32152063b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.528323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4227-8598-4eab-baea-9df32152063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.547770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-dc9f4227-8598-4eab-baea-9df32152063b None None] MFA Rules not processed for user `d0fb7270ef9444348b30a65938ede20a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:55.548928 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dc9f4227-8598-4eab-baea-9df32152063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:55.591420 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:55.598653 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 565/1121] 10.222.0.91 () {58 vars in 1061 bytes} [Tue Aug 23 23:26:55 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:55.608427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc945e-6e52-4719-862d-87877dec13fc None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.619883 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc945e-6e52-4719-862d-87877dec13fc None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.623416 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb7270ef9444348b30a65938ede20a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.624005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.624288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.624607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.633363 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.637054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.643680 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 557/1122] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:55 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:55.683669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6f3f-9136-4e86-946d-f4057628250a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.683960 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6f3f-9136-4e86-946d-f4057628250a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.688705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6f3f-9136-4e86-946d-f4057628250a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.688705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 566/1123] 10.222.0.91 () {52 vars in 830 bytes} [Tue Aug 23 23:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:55.689174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:55.752969 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e5118-3714-43b7-9d5f-29e863fb3231 service cinder] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:55.757596 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:55.758227 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:55.758518 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:55.758795 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] PATH_INFO: `/v3/users/569ea1df2a75450c95e755dd72e43a6f` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:55.759945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569ea1df2a75450c95e755dd72e43a6f)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:55.760990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:55.760990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:26:55.760990 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:26:55.762277 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:55.984535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569ea1df2a75450c95e755dd72e43a6f'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.008124 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569ea1df2a75450c95e755dd72e43a6f'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.022655 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569ea1df2a75450c95e755dd72e43a6f'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.023485 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569ea1df2a75450c95e755dd72e43a6f'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.024176 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569ea1df2a75450c95e755dd72e43a6f'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.028427 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:56.123794 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 558/1124] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 23 23:26:55 2022] DELETE /identity/v3/users/569ea1df2a75450c95e755dd72e43a6f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:56.128554 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:56.129062 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:56.129218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:56.149102 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:56.150320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:56.208880 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 567/1125] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:26:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:26:56.221383 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:56.222805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:56.283161 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1b8a-64db-4563-9f83-73f1bbdee863 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:56.286682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:56.287294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:56.287665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:56.287853 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:56.296826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:56.298277 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1c3d-a992-4f93-b925-40597a303ead service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:56.307652 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 559/1126] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:56.834376 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:56.835886 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:56.849005 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea579fb1-aecb-4549-a4dc-4c482eb65c48 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:56.854995 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:56.855641 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:56.855924 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:56.856200 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] PATH_INFO: `/v3/projects/91b7490ce368447fb6cb7c0b863d17a6` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:56.857392 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b7490ce368447fb6cb7c0b863d17a6)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:56.859139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:56.859139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:26:56.859139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:26:56.861447 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:56.979870 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b7490ce368447fb6cb7c0b863d17a6', 'request_id': 'req-47832bd6-1901-4d24-81e6-97021bbc21a3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:56.994079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b7490ce368447fb6cb7c0b863d17a6', 'request_id': 'req-47832bd6-1901-4d24-81e6-97021bbc21a3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:57.000055 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b7490ce368447fb6cb7c0b863d17a6', 'request_id': 'req-47832bd6-1901-4d24-81e6-97021bbc21a3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:57.069237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] The token cache is being invalidate because project 91b7490ce368447fb6cb7c0b863d17a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:26:57.069527 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:57.070152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-47832bd6-1901-4d24-81e6-97021bbc21a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:57.071766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 568/1127] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 23 23:26:56 2022] DELETE /identity/v3/projects/91b7490ce368447fb6cb7c0b863d17a6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:27:06.303483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:07.066712 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:22.763086 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:22.763683 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:22.763683 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:22.764993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 560/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:22.770306 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad65d-51b7-4eef-b3bb-c8784891f035 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:22.770726 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad65d-51b7-4eef-b3bb-c8784891f035 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:22.770866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad65d-51b7-4eef-b3bb-c8784891f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:22.790948 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4eaad65d-51b7-4eef-b3bb-c8784891f035 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:22.792171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4eaad65d-51b7-4eef-b3bb-c8784891f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:22.851321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 569/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:28:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:23.009883 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:23.011587 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:23.081532 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5530edf-7b0b-40f5-b156-5b457a19d64a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:23.086674 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:23.087319 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:23.087605 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:23.087882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:23.097034 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:23.098669 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db611c1c-0990-4eb8-80c8-71f4b756ed1f service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:23.108045 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 561/1130] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:23.947341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eecdc-a683-4cf5-b38e-f60abc2025d7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:23.947909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eecdc-a683-4cf5-b38e-f60abc2025d7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:23.947909 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eecdc-a683-4cf5-b38e-f60abc2025d7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:23.949266 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 570/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:23.954085 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650349-c59e-4501-a18d-0ee73654fabd None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:23.954527 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650349-c59e-4501-a18d-0ee73654fabd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:23.954632 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650349-c59e-4501-a18d-0ee73654fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:23.974510 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-99650349-c59e-4501-a18d-0ee73654fabd None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:23.975819 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-99650349-c59e-4501-a18d-0ee73654fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:23.983802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 562/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:28:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:24.145385 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eecdc-a683-4cf5-b38e-f60abc2025d7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:24.159877 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eecdc-a683-4cf5-b38e-f60abc2025d7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:24.164947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:24.165582 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:24.165859 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:24.166141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:24.175110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:24.176795 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b341-8692-4aa8-b41f-81f29482c929 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:24.186714 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 571/1133] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:29.490573 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd10f-927e-447a-b05f-4ea1a6bf6e28 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:29.491109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd10f-927e-447a-b05f-4ea1a6bf6e28 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:29.491109 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd10f-927e-447a-b05f-4ea1a6bf6e28 None None] PATH_INFO: `/v3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:29.492332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 563/1134] 10.222.0.95 () {54 vars in 925 bytes} [Tue Aug 23 23:28:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:28:29.499334 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70332c-624c-43de-bd2d-52e11618e845 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:29.499770 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70332c-624c-43de-bd2d-52e11618e845 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:29.499895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70332c-624c-43de-bd2d-52e11618e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:29.530907 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ca70332c-624c-43de-bd2d-52e11618e845 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:29.532676 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ca70332c-624c-43de-bd2d-52e11618e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:29.593830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 572/1135] 10.222.0.95 () {58 vars in 1015 bytes} [Tue Aug 23 23:28:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:33.969840 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=35 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:34.220760 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5861-a50c-4d80-94b9-8dc541dae783 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:34.221050 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5861-a50c-4d80-94b9-8dc541dae783 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:34.221349 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5861-a50c-4d80-94b9-8dc541dae783 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:34.223332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 564/1136] 10.222.0.91 () {54 vars in 961 bytes} [Tue Aug 23 23:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:34.228814 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168084-b172-4bd2-b35a-685725cb7cf6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:34.229259 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168084-b172-4bd2-b35a-685725cb7cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:34.229452 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168084-b172-4bd2-b35a-685725cb7cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:34.251332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5c168084-b172-4bd2-b35a-685725cb7cf6 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:34.252584 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5c168084-b172-4bd2-b35a-685725cb7cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:34.261044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 573/1137] 10.222.0.91 () {58 vars in 1058 bytes} [Tue Aug 23 23:28:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:34.269272 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d5861-a50c-4d80-94b9-8dc541dae783 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:34.283435 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d5861-a50c-4d80-94b9-8dc541dae783 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:34.288387 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:34.289013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:34.289294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:34.289571 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:34.297967 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:34.299555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa572c6-9b98-49c3-bc71-cf23571b5734 service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:34.309261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 565/1138] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:35.437361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1454-14f0-4a4c-9540-0de3a7be88ed None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:35.438374 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1454-14f0-4a4c-9540-0de3a7be88ed None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:35.438489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1454-14f0-4a4c-9540-0de3a7be88ed None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:35.439751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:28:35.446791 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a60b-8c34-4625-b6e1-5f0f9a37881b None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:35.447282 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a60b-8c34-4625-b6e1-5f0f9a37881b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:35.447401 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a60b-8c34-4625-b6e1-5f0f9a37881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:35.470223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-87b9a60b-8c34-4625-b6e1-5f0f9a37881b None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:35.471452 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-87b9a60b-8c34-4625-b6e1-5f0f9a37881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:35.479401 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:28:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:35.639151 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea1454-14f0-4a4c-9540-0de3a7be88ed None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:35.653264 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea1454-14f0-4a4c-9540-0de3a7be88ed None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:35.658712 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:35.660735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:35.660735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:35.660735 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:35.667877 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:35.669485 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0dce6-0fde-4e78-982e-b579fc607d47 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:35.679506 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 575/1141] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:36.520925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832609-f35c-43d4-8241-93a9b9a471a1 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:36.521462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832609-f35c-43d4-8241-93a9b9a471a1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:36.521462 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832609-f35c-43d4-8241-93a9b9a471a1 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:36.523013 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 567/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:36.527964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032ce2-42fd-4bda-9d19-5acfaeba9a33 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:36.528355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032ce2-42fd-4bda-9d19-5acfaeba9a33 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:36.528557 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87032ce2-42fd-4bda-9d19-5acfaeba9a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:36.548463 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-87032ce2-42fd-4bda-9d19-5acfaeba9a33 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:36.549702 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-87032ce2-42fd-4bda-9d19-5acfaeba9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:36.557583 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 576/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:28:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:36.717046 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832609-f35c-43d4-8241-93a9b9a471a1 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:36.731316 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832609-f35c-43d4-8241-93a9b9a471a1 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:36.736416 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:36.737043 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:36.737325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:36.737598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:36.745762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:36.747331 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e448f-0aac-4acf-89e0-112823a47050 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:36.757192 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 568/1144] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:40.894806 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:40.895368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:40.895368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:40.897118 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:40.902341 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149006ca-65ee-4d81-bb37-af8ad0dcf5b7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:40.902786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149006ca-65ee-4d81-bb37-af8ad0dcf5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:40.902891 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149006ca-65ee-4d81-bb37-af8ad0dcf5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:40.923432 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-149006ca-65ee-4d81-bb37-af8ad0dcf5b7 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:40.924672 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-149006ca-65ee-4d81-bb37-af8ad0dcf5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:40.932461 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:41.283057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:41.284865 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:41.337891 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:41.343477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a72a31-2bf7-44fc-9e18-03e44dda235f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:41.347617 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:41.348274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:41.348602 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:41.348882 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:41.357961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:41.359531 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d8b35-eb10-44ce-89aa-4a2d78a72f39 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:41.369017 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 578/1147] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:43.537938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ca8-6426-46c8-a1c9-80301ad99ae2 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:43.538511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ca8-6426-46c8-a1c9-80301ad99ae2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:43.538511 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354ca8-6426-46c8-a1c9-80301ad99ae2 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:43.539829 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 570/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:43.545002 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ced8-dce3-4fb2-9039-1488e88782b6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:43.545419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ced8-dce3-4fb2-9039-1488e88782b6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:43.545565 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ced8-dce3-4fb2-9039-1488e88782b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:43.565996 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6e87ced8-dce3-4fb2-9039-1488e88782b6 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:43.567223 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6e87ced8-dce3-4fb2-9039-1488e88782b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:43.575036 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 579/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:43.920577 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354ca8-6426-46c8-a1c9-80301ad99ae2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:43.931292 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354ca8-6426-46c8-a1c9-80301ad99ae2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:43.934786 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:43.935369 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:43.935648 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:43.935918 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:43.945475 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:43.946907 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73b475-0326-4a7c-a7ca-8e258f0598d3 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:43.957061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 571/1150] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:48.060357 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:48.060958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:48.060958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:48.062237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 580/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:48.067649 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1006a7-175a-42b0-900e-1b0bc785501a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:48.068088 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1006a7-175a-42b0-900e-1b0bc785501a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:48.068201 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1006a7-175a-42b0-900e-1b0bc785501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:48.087832 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-6e1006a7-175a-42b0-900e-1b0bc785501a None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:48.089065 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-6e1006a7-175a-42b0-900e-1b0bc785501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:48.097466 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 572/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:48.674604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:48.676313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:48.732911 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd4d0-1da6-40df-b04f-a53c54a6b25b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:48.737121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb7270ef9444348b30a65938ede20a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:48.737728 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:48.738013 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:48.738289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:48.747626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:48.749110 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b29e5-da97-48e2-a2f2-5c2a4524c1ed service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:48.759376 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 581/1153] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:51.090054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da772-1c76-4d40-868f-11c07f170074 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:51.090054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da772-1c76-4d40-868f-11c07f170074 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:51.090054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da772-1c76-4d40-868f-11c07f170074 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:51.090054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 573/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:28:51.096078 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6edfd-ff4b-4961-ae46-6b4c41566ce2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:51.096708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6edfd-ff4b-4961-ae46-6b4c41566ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:51.096708 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6edfd-ff4b-4961-ae46-6b4c41566ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:51.116694 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f6c6edfd-ff4b-4961-ae46-6b4c41566ce2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:51.117937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f6c6edfd-ff4b-4961-ae46-6b4c41566ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:51.127117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 582/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:28:51.709835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da772-1c76-4d40-868f-11c07f170074 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:51.711514 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-672da772-1c76-4d40-868f-11c07f170074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:51.724816 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da772-1c76-4d40-868f-11c07f170074 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:51.728264 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb7270ef9444348b30a65938ede20a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:51.728890 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:51.729166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:51.729440 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:51.738337 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:51.739749 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486cea2-b1a2-4d00-8621-0ecd73cee549 service cinder] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:51.748972 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 574/1156] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:01.111430 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=37 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:01.745212 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=33 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:08.160970 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.161769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.161769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.183503 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:08.184845 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:08.196489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 583/1157] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:08.202196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.202753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.202753 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.224679 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:08.225826 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:08.234505 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 575/1158] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:08.240319 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.250926 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4860bc1-b549-4553-988e-d48dd741323f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.256372 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.257054 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.257343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.257626 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.258305 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:30:08.258613 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.260358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.277033 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 584/1159] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 23 23:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:30:08.287872 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.304413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd73b9-57fa-43af-8bdf-643c628b1a6f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.304413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.304413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.304413 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.304931 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.304931 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.306621 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd806b2-cfcb-4b70-b094-8835fe0ece94 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.421763 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 576/1160] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:08.427107 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.438309 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0096-2b1b-4e61-a179-4d5136261068 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.450094 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3354-6c32-485f-8f91-d9e2e7d8fdb2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.450393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3354-6c32-485f-8f91-d9e2e7d8fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.450672 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3354-6c32-485f-8f91-d9e2e7d8fdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.470962 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a09c3354-6c32-485f-8f91-d9e2e7d8fdb2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:08.472858 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a09c3354-6c32-485f-8f91-d9e2e7d8fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:08.499411 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.500028 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.500313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.500623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.501287 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.503313 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.540256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 577/1161] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:30:08.548654 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.548945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.549223 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.570501 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:08.571687 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:08.579713 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 578/1162] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:30:08.584524 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.593443 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bcff-8567-4e2e-bd50-946a0a5ad4c2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.597953 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 585/1163] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:08.604924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.604924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.604924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.604924 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:30:08.605290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.607603 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.616736 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 579/1164] 10.222.0.91 () {58 vars in 1153 bytes} [Tue Aug 23 23:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:30:08.618440 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb5bd-3761-460f-8ba9-d03dd45c024a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.623253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.623876 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.624171 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.624466 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.625126 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.625292 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.626756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.636269 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc9c5-cd50-4789-b45e-0eda59e0436a admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.638332 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 586/1165] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:08.641256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.641873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.642160 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.642303 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.642445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.643054 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.645900 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.653069 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8075ee-e78c-415d-b588-a9ea24e4c3b8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.657862 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.658477 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.658771 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.659050 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.660323 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.662519 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.673011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 587/1166] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:08.679879 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.691367 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff71ba-7c71-407b-84d9-66a5e78e567c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.700538 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.701245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.701522 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.701818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] PATH_INFO: `/v3/projects/1196022c84174e3895adeec289dde9bc/users/4f889288a46740f68d536ea51acfd84c/roles/686d6006762640dba07b0fb12570a686` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.718303 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1196022c84174e3895adeec289dde9bc, user_id=4f889288a46740f68d536ea51acfd84c, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.719361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:08.719361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:30:08.719361 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:30:08.721388 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3a44-7b37-4e4b-9166-fe7da08405ea admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.788256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 580/1167] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:30:08.792478 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.814431 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 588/1168] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:08 2022] PUT /identity/v3/projects/1196022c84174e3895adeec289dde9bc/users/4f889288a46740f68d536ea51acfd84c/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:30:08.820349 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.820723 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.820947 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.841311 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:08.842552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:08.858828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecb9c-6c88-40ef-8bb1-081213cab085 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.904368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:08.905884 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 589/1169] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:30:08.929433 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:08.933689 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:08.934309 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:08.934592 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:08.934880 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:08.935513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:08.936560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:08.936560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:30:08.936560 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:30:08.937801 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:08.963864 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:08.996097 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a137aa-e0fa-483a-af01-4dc85a1578ef None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:08.999839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:09.000457 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.000766 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.001040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.011226 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:09.012764 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:09.023412 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 590/1170] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:30:09.067246 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 581/1171] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:30:08 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:30:09.072327 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:09.083474 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1395e-f95c-447f-aa79-7f67428c489a service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:09.088196 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:09.088827 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.089127 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.089402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.090308 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:09.091925 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:09.103152 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 591/1172] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:30:09.107322 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:09.123619 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e2f9-b874-443c-8488-b276665812de admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:09.124325 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:09.124978 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.125261 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.125536 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.126186 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:09.127802 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb2676-2f23-46d8-912d-6653980aa016 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:09.143489 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 582/1173] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:30:09.145430 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:09.156372 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335dc66-b30c-4abc-bd4b-f078d9899dde admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:09.162166 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:09.162768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.162858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.163104 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] PATH_INFO: `/v3/projects/e39a2d6240454b45b70db05534dc6a8c/users/3088294ebe074269bcdcc9ef5148d575/roles/686d6006762640dba07b0fb12570a686` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.181092 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39a2d6240454b45b70db05534dc6a8c, user_id=3088294ebe074269bcdcc9ef5148d575, role_id=686d6006762640dba07b0fb12570a686)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:09.183915 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:09.239905 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 592/1174] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:09 2022] PUT /identity/v3/projects/e39a2d6240454b45b70db05534dc6a8c/users/3088294ebe074269bcdcc9ef5148d575/roles/686d6006762640dba07b0fb12570a686 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:30:09.246481 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e90-68f4-4e57-baa5-bcd2e6e89245 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.247020 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e90-68f4-4e57-baa5-bcd2e6e89245 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.247118 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e90-68f4-4e57-baa5-bcd2e6e89245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.267253 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c20a5e90-68f4-4e57-baa5-bcd2e6e89245 None None] MFA Rules not processed for user `c1ea3af316ee47e789d80e3a6d797918`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:09.268499 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c20a5e90-68f4-4e57-baa5-bcd2e6e89245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:09.361205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 583/1175] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:09.370594 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:09.372356 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:09.448709 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04328-f58a-468d-8755-6cf84de03f46 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:09.453866 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:09.454601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:09.454893 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:09.455154 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:09.465114 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:09.466564 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:09.478489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 593/1176] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:16.445166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:16.446347 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:16.446839 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:16.522859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] MFA Rules not processed for user `4f889288a46740f68d536ea51acfd84c`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:16.524190 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:16.694714 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:16.695602 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 584/1177] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:16 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:16.710818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5550e-720c-42ba-b172-42e26162888e service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:16.724571 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:16.725730 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:16.726236 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:16.726488 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:16.727830 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:16.728982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:16.728982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:30:16.728982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:30:16.731084 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:16.868008 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 594/1178] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 23 23:30:16 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:16.873393 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:16.916812 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102abd5b-12e1-4030-8765-21825b5226c9 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.129776 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:17.207324 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.208414 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.208879 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.209298 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.210222 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.212380 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.297335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 585/1179] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:30:16 2022] POST /identity/v3/users => generated 299 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:17.297441 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.316060 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d44e-8058-42d3-8d89-1b852e6d1159 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.335146 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.336358 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.336930 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.337422 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.340958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.342917 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2e8c1-d61b-412c-91b3-220de6f7c0a5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.365175 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 595/1180] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:17.375661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.430693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346b4f1-2f5b-484b-86e3-ff74781fcca7 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.475906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.476135 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.476637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.476637 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.476806 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.477235 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.477588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] PATH_INFO: `/v3/projects/207592a65a6043b195cb40e468f8f2ab/users/ca3b158800314739af35e4c54d73d084/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.507923 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207592a65a6043b195cb40e468f8f2ab, user_id=ca3b158800314739af35e4c54d73d084, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.510981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.517501 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] MFA Rules not processed for user `3088294ebe074269bcdcc9ef5148d575`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:17.521115 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:17.591835 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:17.609824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 586/1181] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:17 2022] PUT /identity/v3/projects/207592a65a6043b195cb40e468f8f2ab/users/ca3b158800314739af35e4c54d73d084/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:17.614084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.617248 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 596/1182] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:30:17.625599 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.640020 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be809c7-7049-49ca-9a60-a2d86e25603e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.710463 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82858fb-fda2-41db-bc6c-be6689a8ff82 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.715824 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.716139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.716662 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.716809 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.716920 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.717066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.717183 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.717339 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.717863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.717977 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.719676 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.719908 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.732953 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 587/1183] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:17.736911 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.748630 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5802-07b8-4b0b-be10-2eab1c8c23e1 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.754522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.755381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.755671 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.755957 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] PATH_INFO: `/v3/projects/207592a65a6043b195cb40e468f8f2ab/users/ca3b158800314739af35e4c54d73d084/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.758093 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207592a65a6043b195cb40e468f8f2ab, user_id=ca3b158800314739af35e4c54d73d084, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.760859 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:17.774711 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 588/1184] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:17 2022] PUT /identity/v3/projects/207592a65a6043b195cb40e468f8f2ab/users/ca3b158800314739af35e4c54d73d084/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:30:17.820563 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 597/1185] 10.222.0.91 () {60 vars in 1153 bytes} [Tue Aug 23 23:30:17 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:17.822751 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:17.907925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99320d-9f98-494b-a481-d00389e69a66 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:17.970468 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:17.995366 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:17.996031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:17.996291 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:17.996595 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:17.997248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:17.999515 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:18.108500 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 589/1186] 10.222.0.91 () {60 vars in 1144 bytes} [Tue Aug 23 23:30:17 2022] POST /identity/v3/users => generated 295 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:30:18.109255 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:18.122281 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f05f7-e56a-452a-9712-ed11b12d2388 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:18.131056 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:18.132022 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:18.132555 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:18.133038 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:18.133889 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:18.135781 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:18.154753 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 598/1187] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:18.155974 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:18.173975 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c482b3-c829-49fe-bbcf-78cbf24b8408 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:18.180579 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:18.181960 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:18.182279 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:18.182561 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] PATH_INFO: `/v3/projects/1ba38a54a00146b18b34af0f4ce24d11/users/cb70c2572c94487c92605c35dbbaae97/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:18.211082 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba38a54a00146b18b34af0f4ce24d11, user_id=cb70c2572c94487c92605c35dbbaae97, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:18.214156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:18.349728 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 590/1188] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:18 2022] PUT /identity/v3/projects/1ba38a54a00146b18b34af0f4ce24d11/users/cb70c2572c94487c92605c35dbbaae97/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:18.353468 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:18.369505 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816b15-0ce0-42ba-8f1b-45d11492fe5a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:18.467489 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:18.468184 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:18.468846 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:18.469160 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:18.469961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:18.483159 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeade96-785b-4a6f-85d6-a93188542b63 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:18.500906 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 599/1189] 10.222.0.91 () {58 vars in 1122 bytes} [Tue Aug 23 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:30:18.505119 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:18.523256 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8bebd-8e98-461f-bb05-d1d88d089389 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:18.532616 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:18.533814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:18.534194 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:18.535174 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] PATH_INFO: `/v3/projects/1ba38a54a00146b18b34af0f4ce24d11/users/cb70c2572c94487c92605c35dbbaae97/roles/27562aa899b24a498ff1887ceca94449` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:18.539361 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba38a54a00146b18b34af0f4ce24d11, user_id=cb70c2572c94487c92605c35dbbaae97, role_id=27562aa899b24a498ff1887ceca94449)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:18.546439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:18.566450 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 591/1190] 10.222.0.91 () {60 vars in 1483 bytes} [Tue Aug 23 23:30:18 2022] PUT /identity/v3/projects/1ba38a54a00146b18b34af0f4ce24d11/users/cb70c2572c94487c92605c35dbbaae97/roles/27562aa899b24a498ff1887ceca94449 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:25.584320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1cc9a-6670-4c74-8e79-4c1b4760afd7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:25.585989 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1cc9a-6670-4c74-8e79-4c1b4760afd7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:25.586333 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1cc9a-6670-4c74-8e79-4c1b4760afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:25.624339 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b6b1cc9a-6670-4c74-8e79-4c1b4760afd7 None None] MFA Rules not processed for user `ca3b158800314739af35e4c54d73d084`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:25.625888 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b6b1cc9a-6670-4c74-8e79-4c1b4760afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:25.695070 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:25.730861 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 600/1191] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:25 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:25.740389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:25.742450 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:25.815241 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ce2b-cbf5-4bad-a5e0-70433bea80ef admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:25.820126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71640ebebcef490e9f3425f7559e3b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:25.821023 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:25.821381 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:25.821727 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:25.893073 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:25.894993 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:25.905487 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 592/1192] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:25 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:26.504432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa3aa-4bff-4fe1-9da1-1255c6245d78 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:26.504432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa3aa-4bff-4fe1-9da1-1255c6245d78 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:26.504432 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa3aa-4bff-4fe1-9da1-1255c6245d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:26.536622 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f85aa3aa-4bff-4fe1-9da1-1255c6245d78 None None] MFA Rules not processed for user `cb70c2572c94487c92605c35dbbaae97`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:26.538035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f85aa3aa-4bff-4fe1-9da1-1255c6245d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:26.624955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 601/1193] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:26 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:26.692644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:26.692644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ec8c-94fe-4f79-b82c-f215d7636932 service glance] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:26.692644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71640ebebcef490e9f3425f7559e3b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:26.692644 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:26.693130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:26.693130 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:26.723583 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:26.744313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:26.746715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ff9f-a347-487e-a66f-257b1ab75dfd service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:26.760056 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 593/1194] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:26 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:30:36.621803 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=40 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:36.848862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:36.944024 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae42a6-41b5-43eb-afd1-62319b055804 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:36.944895 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae42a6-41b5-43eb-afd1-62319b055804 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:36.945410 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae42a6-41b5-43eb-afd1-62319b055804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:36.969962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c8ae42a6-41b5-43eb-afd1-62319b055804 None None] MFA Rules not processed for user `4f889288a46740f68d536ea51acfd84c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:36.971218 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c8ae42a6-41b5-43eb-afd1-62319b055804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:36.980754 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 602/1195] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:30:36 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:37.311705 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02f89-e84f-4483-9679-e29bf16de07d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.311999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02f89-e84f-4483-9679-e29bf16de07d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.312281 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02f89-e84f-4483-9679-e29bf16de07d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.314097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 594/1196] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 23 23:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:37.322530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cda80-316c-4c26-b7eb-0c31414d2a24 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.322530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cda80-316c-4c26-b7eb-0c31414d2a24 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.323138 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cda80-316c-4c26-b7eb-0c31414d2a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.347282 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-283cda80-316c-4c26-b7eb-0c31414d2a24 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:37.349043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-283cda80-316c-4c26-b7eb-0c31414d2a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:37.437740 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 603/1197] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 23 23:30:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:37.443901 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.444252 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.444567 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.447665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 595/1198] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 23 23:30:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:37.459487 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e27-f8fc-4904-a040-c4285ce9eb96 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.459911 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e27-f8fc-4904-a040-c4285ce9eb96 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.460189 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e27-f8fc-4904-a040-c4285ce9eb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.482988 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3e788e27-f8fc-4904-a040-c4285ce9eb96 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:37.484209 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3e788e27-f8fc-4904-a040-c4285ce9eb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:37.494697 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 604/1199] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 23 23:30:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:37.509132 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:37.511973 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:37.528513 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b960ec-094e-4c32-8a39-444bf1345231 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:37.532343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71640ebebcef490e9f3425f7559e3b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:37.533254 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.533670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.534012 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.548368 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:37.549995 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74b0c6-ae26-4e72-88c6-8058bbefd1e0 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:37.563084 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 596/1200] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:37.962212 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70503d-4133-4207-acac-7464b5f617db None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.962758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70503d-4133-4207-acac-7464b5f617db None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.962937 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70503d-4133-4207-acac-7464b5f617db None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.964274 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 605/1201] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 23 23:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:37.971330 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f67a-7516-422a-bf53-3d7fce605d73 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.971833 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f67a-7516-422a-bf53-3d7fce605d73 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.971938 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f67a-7516-422a-bf53-3d7fce605d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.995300 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-bce8f67a-7516-422a-bf53-3d7fce605d73 None None] MFA Rules not processed for user `ab7ee24711494e088ca175321680612f`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:37.996667 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-bce8f67a-7516-422a-bf53-3d7fce605d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:38.061701 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 597/1202] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 23 23:30:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:38.077576 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70503d-4133-4207-acac-7464b5f617db None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:38.092512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70503d-4133-4207-acac-7464b5f617db None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:38.097585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:38.097585 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.097869 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.097978 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.108139 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:38.110011 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e3851-c4cb-49e3-98d5-9dfa8700534f service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:38.120000 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 606/1203] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:38 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:38.730796 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b8d1-897d-4376-a571-c34bd9ce9a61 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.731080 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b8d1-897d-4376-a571-c34bd9ce9a61 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.731359 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b8d1-897d-4376-a571-c34bd9ce9a61 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.733017 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 598/1204] 10.222.0.91 () {54 vars in 962 bytes} [Tue Aug 23 23:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:38.743899 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a6a9-8f38-4300-b576-f1a122c87bdc None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.749752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a6a9-8f38-4300-b576-f1a122c87bdc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.749752 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a6a9-8f38-4300-b576-f1a122c87bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.780302 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-30b2a6a9-8f38-4300-b576-f1a122c87bdc None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:38.783915 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-30b2a6a9-8f38-4300-b576-f1a122c87bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:38.798009 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8698d-2839-4379-9078-6d6a6758d126 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.798356 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8698d-2839-4379-9078-6d6a6758d126 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.799502 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8698d-2839-4379-9078-6d6a6758d126 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.803345 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 599/1206] 10.222.0.91 () {54 vars in 961 bytes} [Tue Aug 23 23:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:38.804850 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abbe13-e5d9-4f50-b5bb-668ecca00f03 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.805311 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abbe13-e5d9-4f50-b5bb-668ecca00f03 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.805814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abbe13-e5d9-4f50-b5bb-668ecca00f03 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.808692 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 607/1207] 10.222.0.91 () {58 vars in 1059 bytes} [Tue Aug 23 23:30:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:38.808958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 600/1207] 10.222.0.91 () {54 vars in 912 bytes} [Tue Aug 23 23:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:38.813964 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.815141 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.815690 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.819258 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977be8-6d32-4903-9d1e-4def23b86e17 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.819778 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977be8-6d32-4903-9d1e-4def23b86e17 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.820204 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977be8-6d32-4903-9d1e-4def23b86e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.852301 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:38.853677 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:38.865030 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-91977be8-6d32-4903-9d1e-4def23b86e17 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:38.868111 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-91977be8-6d32-4903-9d1e-4def23b86e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:38.868237 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 608/1208] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 23 23:30:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:30:38.885251 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:38.903705 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69952be-0615-4cf6-b2f2-afd34439c86b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:38.908841 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:38.909560 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:38.909975 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:38.910968 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:38.925170 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:38.927034 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:38.939918 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 609/1209] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:38.977378 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 601/1210] 10.222.0.91 () {58 vars in 1058 bytes} [Tue Aug 23 23:30:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:38.985768 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:39.000765 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d5c2-ebce-4ecf-b757-8249ece52315 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:39.013573 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:39.014388 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:39.014915 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:39.015825 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:39.018109 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:39.058514 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:39.060117 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:39.074823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 610/1211] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:48.961244 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=58 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:49.070043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=59 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:54.656205 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e443d-e564-4d74-9778-b25a5936e801 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:54.656765 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e443d-e564-4d74-9778-b25a5936e801 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:54.656854 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e443d-e564-4d74-9778-b25a5936e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:54.677238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-db1e443d-e564-4d74-9778-b25a5936e801 None None] MFA Rules not processed for user `ab7ee24711494e088ca175321680612f`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:54.678535 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-db1e443d-e564-4d74-9778-b25a5936e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:54.685842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 602/1212] 10.222.0.95 () {58 vars in 1015 bytes} [Tue Aug 23 23:30:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:54.698722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:54.708429 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286f064-f979-4eac-9169-39592f4a4f61 service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:54.712070 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:54.712712 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:54.713020 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:54.713288 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:54.731821 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:54.737558 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ea33-8300-4165-97ae-54533656c7ab service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:54.746818 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 611/1213] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:55.640539 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0015-c2cf-4249-a324-48b3c281c0ef None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:55.640849 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0015-c2cf-4249-a324-48b3c281c0ef None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:55.641196 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0015-c2cf-4249-a324-48b3c281c0ef None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:55.642843 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 603/1214] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:30:55.685590 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d9db0-68c7-470e-88dc-21a0d1763d08 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:55.685878 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d9db0-68c7-470e-88dc-21a0d1763d08 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:55.686155 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d9db0-68c7-470e-88dc-21a0d1763d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:55.706782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-671d9db0-68c7-470e-88dc-21a0d1763d08 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:55.708786 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-671d9db0-68c7-470e-88dc-21a0d1763d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:55.719134 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 612/1215] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:30:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:55.746103 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0015-c2cf-4249-a324-48b3c281c0ef None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:55.763031 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0015-c2cf-4249-a324-48b3c281c0ef None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:55.769248 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:55.769953 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:55.770233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:55.770512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:55.789893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:55.791533 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9c0e-1f1c-4900-98b6-573830418ddb service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:55.803917 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 604/1216] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:30:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:03.963192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba609-9efb-47b0-9fce-40b3b2bef040 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:03.963796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba609-9efb-47b0-9fce-40b3b2bef040 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:03.963796 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba609-9efb-47b0-9fce-40b3b2bef040 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:03.965253 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 613/1217] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:31:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:03.972096 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:03.972664 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:03.973112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:03.992981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:03.994226 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:04.003155 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 605/1218] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:31:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:04.015777 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba609-9efb-47b0-9fce-40b3b2bef040 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:04.030994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba609-9efb-47b0-9fce-40b3b2bef040 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:04.036289 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:04.037010 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:04.037403 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:04.037744 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:04.057365 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:04.059232 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36910b4-6ca2-494a-9f08-ec6b2cd30b90 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:04.072769 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 614/1219] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:13.987977 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=12 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:14.072343 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=15 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:21.831059 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:21.840402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b12a24-f712-40f5-a51c-a659f2b168ba None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:21.844079 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:21.844779 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:21.845127 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:21.845483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:21.855639 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:21.863844 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80b2d0-8dd3-4987-805e-3ac416c4de8e service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:21.866661 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 606/1220] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:21 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:24.554556 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251a54-1ce5-4e6a-9384-efd201feb089 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:24.555572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251a54-1ce5-4e6a-9384-efd201feb089 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:24.555572 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251a54-1ce5-4e6a-9384-efd201feb089 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:24.556839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 615/1221] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:24.561945 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8f79-23b9-4e24-8c67-eb0d23001440 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:24.562439 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8f79-23b9-4e24-8c67-eb0d23001440 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:24.562691 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8f79-23b9-4e24-8c67-eb0d23001440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:24.588619 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-01cf8f79-23b9-4e24-8c67-eb0d23001440 None None] MFA Rules not processed for user `a3307a556ec14aec850542633862b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:24.590751 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-01cf8f79-23b9-4e24-8c67-eb0d23001440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:24.611827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 607/1222] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:31:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:24.622604 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251a54-1ce5-4e6a-9384-efd201feb089 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:24.646478 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251a54-1ce5-4e6a-9384-efd201feb089 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:24.658350 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:24.659058 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:24.660711 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:24.665222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:24.678386 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:24.680040 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d270589-275e-4b9f-aab1-7e8a7290c14d service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:24.693530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 616/1223] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:34.582442 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=9 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:34.686668 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:32.762343 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:32.762873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:32.762873 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:32.794606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] MFA Rules not processed for user `3088294ebe074269bcdcc9ef5148d575`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:32.795822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:32.825245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 608/1224] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:32:32 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:33.145416 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28892-6cf8-4923-a3ce-a4e02f86b1f5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:33.145919 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28892-6cf8-4923-a3ce-a4e02f86b1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:33.146049 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28892-6cf8-4923-a3ce-a4e02f86b1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:33.202763 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7ab28892-6cf8-4923-a3ce-a4e02f86b1f5 None None] MFA Rules not processed for user `ab7ee24711494e088ca175321680612f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:33.203904 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7ab28892-6cf8-4923-a3ce-a4e02f86b1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:33.237847 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 617/1225] 10.222.0.91 () {58 vars in 1009 bytes} [Tue Aug 23 23:32:33 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:33.249410 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:33.259771 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8fe4-9398-46c7-8580-fa394620e807 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:33.263428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:33.264033 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:33.264318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:33.264641 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:33.272546 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:33.274512 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:33.282981 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 609/1226] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:32:33 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:43.234823 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=28 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:43.279114 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=21 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:15.239543 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bcaad-98ba-4a77-820d-22c0dc8768b1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:15.240076 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bcaad-98ba-4a77-820d-22c0dc8768b1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:15.240076 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bcaad-98ba-4a77-820d-22c0dc8768b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:15.260615 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-940bcaad-98ba-4a77-820d-22c0dc8768b1 None None] MFA Rules not processed for user `3088294ebe074269bcdcc9ef5148d575`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:33:15.261840 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-940bcaad-98ba-4a77-820d-22c0dc8768b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:15.268667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 618/1227] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:33:15 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:33:25.255031 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:35.781773 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:35.801318 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1645-16ed-4f75-addb-14bbb7fbeba0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:35.801958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1645-16ed-4f75-addb-14bbb7fbeba0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:35.801958 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b1645-16ed-4f75-addb-14bbb7fbeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:35.816665 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dacca5-f0f9-4719-93bf-99cd38f443bc service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:35.822634 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:35.826811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:35.826811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:35.826811 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:35.827087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-497b1645-16ed-4f75-addb-14bbb7fbeba0 None None] MFA Rules not processed for user `3088294ebe074269bcdcc9ef5148d575`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:33:35.827087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-497b1645-16ed-4f75-addb-14bbb7fbeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:35.833222 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 619/1228] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:33:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:33:35.834403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:35.836797 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:35.849682 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 610/1229] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:33:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:33:45.817397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:45.845762 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=13 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:35:05.046756 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:35:05.047293 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:35:05.047293 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:35:05.066140 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] MFA Rules not processed for user `3088294ebe074269bcdcc9ef5148d575`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:35:05.067379 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:35:05.075194 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 620/1230] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:35:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:35:15.060994 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:35:23.021267 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:35:23.031288 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e664-5fbd-4c3a-b93a-ace29a4772a8 service placement] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:35:23.035290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:35:23.035893 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:35:23.036179 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:35:23.036486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:35:23.046148 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:35:23.047578 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:35:23.057431 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 611/1231] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:35:23 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:35:33.053052 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:36:24.838961 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:24.860326 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6c228-f4fb-4764-a3b4-b0ed96a8cc41 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:24.866345 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:24.870935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:24.870935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:24.870935 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:24.875725 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:24.877390 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:24.887083 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 621/1232] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:24 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:24.937232 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:24.946741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5e21-fdf5-43aa-a519-356a8366f20b service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:24.950402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:24.950997 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:24.951280 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:24.951613 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:24.961236 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:24.962658 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:24.972863 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 612/1233] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:25.492916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:25.505601 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5517ff-0fbc-491b-a1eb-73e1c96d5c7a service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:25.512373 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:25.513135 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:25.513497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:25.513847 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:25.525419 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:25.527103 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:25.539321 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 622/1234] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:25.608334 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:25.619999 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca426e-7ac4-4022-9bf7-6e6b5b24d56c service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:25.625097 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:25.625881 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:25.626294 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:25.627377 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:25.635746 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:25.637364 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:25.647403 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 613/1235] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:25 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:27.434805 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:27.445930 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1404-2493-405a-a30e-afaee640e4ed service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:27.457581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:27.457581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:27.457581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:27.457581 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:27.469340 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:27.471542 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625b29-be8a-4a6b-9e92-3f4fe74fd19c service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:27.485791 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 623/1236] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:27.585233 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:27.662638 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310b4eb-0204-407a-ad81-be09f4890fdc service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:27.666810 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb7270ef9444348b30a65938ede20a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:27.667454 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:27.667734 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:27.668005 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:27.679313 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:27.680937 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:27.692354 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 614/1237] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:37.481625 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=22 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:36:37.687262 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=42 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:36:52.503727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:52.504312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:52.504312 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:52.524061 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] MFA Rules not processed for user `4f889288a46740f68d536ea51acfd84c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:36:52.525320 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:36:52.532239 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 624/1238] 10.222.0.91 () {58 vars in 958 bytes} [Tue Aug 23 23:36:52 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:36:53.270290 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:53.282476 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607f996-cfd4-4189-9971-4ae688d63d25 service cinder] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:53.288301 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:53.291719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:53.291719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:53.291719 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:53.302105 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:53.303807 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:53.319245 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 615/1239] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:02.518525 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:03.313857 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:13.594245 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:13.606813 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291000f-c373-48c3-8bc7-d2cb198b727e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:13.612460 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:13.613086 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:13.613370 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:13.613650 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:13.623388 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:13.626667 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:13.635950 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 625/1240] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:23.630982 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:26.903828 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:26.913906 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850336fd-cf56-4bc2-a1b1-7d8001462cc8 service placement] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:26.918412 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:26.919019 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:26.919296 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:26.919582 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:26.929607 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:26.931061 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:26.941159 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 616/1241] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:26 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:36.936757 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:38:41.735439 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:38:41.737057 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:38:41.764926 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c1054-961d-4471-8ba2-8ae708296e90 service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:38:41.769955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:38:41.770574 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:38:41.770858 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:38:41.771136 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:38:41.773099 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:38:41.785716 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:38:41.787341 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:38:41.798782 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 626/1242] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:38:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:38:49.197882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:38:49.209445 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141599a-5ade-4cd6-a822-f611a614da1a service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:38:49.216166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3307a556ec14aec850542633862b57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:38:49.216166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:38:49.216166 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:38:49.218575 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:38:49.225537 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:38:49.227191 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa64497-e61a-4ca4-8500-4f6eab821a76 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:38:49.238375 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 617/1243] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:38:49 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:38:51.793682 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=11 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:38:59.234318 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:04.837340 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:04.838962 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:04.864030 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de333-da06-4246-b33e-ece8623f9aab service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:04.867836 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:04.868471 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:04.868755 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:04.869035 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:04.942722 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:04.944158 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06972154-a350-4bf2-9086-3ba50f0c1fbf service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:04.963236 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 627/1244] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:39:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:39:08.845925 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9259-3461-462b-b6da-7a68a9468165 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:08.846522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9259-3461-462b-b6da-7a68a9468165 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:08.846522 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9259-3461-462b-b6da-7a68a9468165 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:08.848555 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 618/1245] 10.222.0.91 () {54 vars in 921 bytes} [Tue Aug 23 23:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:39:08.882091 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:08.884670 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:08.884670 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:08.926276 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] MFA Rules not processed for user `1b02617b277d4205a247fbae67b78732`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:39:08.927497 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:08.937530 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 628/1246] 10.222.0.91 () {58 vars in 1018 bytes} [Tue Aug 23 23:39:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:39:08.949386 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9259-3461-462b-b6da-7a68a9468165 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:08.963653 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9259-3461-462b-b6da-7a68a9468165 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:08.968827 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:08.971486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:08.971486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:08.971486 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:08.980126 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:08.981745 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:08.993335 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 619/1247] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:39:08 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:39:12.816838 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:12.831123 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ef40-4b42-4df7-bf4d-1b162b7fefc2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:12.838202 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:12.839121 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:12.839402 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:12.839725 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] PATH_INFO: `/v3/users/3088294ebe074269bcdcc9ef5148d575` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:12.841044 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3088294ebe074269bcdcc9ef5148d575)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:12.842425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: WARNING py.warnings [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:39:12.842425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: warnings.warn(msg) Aug 23 23:39:12.842425 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: Aug 23 23:39:12.843916 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:13.165575 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3088294ebe074269bcdcc9ef5148d575'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.177192 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3088294ebe074269bcdcc9ef5148d575'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.177972 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3088294ebe074269bcdcc9ef5148d575'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.271955 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3088294ebe074269bcdcc9ef5148d575'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.272720 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3088294ebe074269bcdcc9ef5148d575'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.302570 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 629/1248] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 23 23:39:12 2022] DELETE /identity/v3/users/3088294ebe074269bcdcc9ef5148d575 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:39:13.566332 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:13.577510 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d9c9-d4ac-43d9-9517-be9e5699e874 service placement] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:13.643200 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:13.643842 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:13.644128 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:13.644402 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] PATH_INFO: `/v3/projects/e39a2d6240454b45b70db05534dc6a8c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:13.645598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39a2d6240454b45b70db05534dc6a8c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:13.646622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:39:13.646622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 23 23:39:13.646622 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: Aug 23 23:39:13.647814 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:13.775483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39a2d6240454b45b70db05534dc6a8c', 'request_id': 'req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.782668 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39a2d6240454b45b70db05534dc6a8c', 'request_id': 'req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.855173 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39a2d6240454b45b70db05534dc6a8c', 'request_id': 'req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.895598 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] The token cache is being invalidate because project e39a2d6240454b45b70db05534dc6a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:39:13.895897 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.896588 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:13.898120 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 620/1249] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 23 23:39:13 2022] DELETE /identity/v3/projects/e39a2d6240454b45b70db05534dc6a8c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:39:13.902852 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:13.905119 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:13.922042 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973198-033b-4f6f-aadf-08b80b5b5509 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:13.936772 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:13.988384 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:13.989071 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:13.989355 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:13.989633 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] PATH_INFO: `/v3/users/cb70c2572c94487c92605c35dbbaae97` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:13.991242 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb70c2572c94487c92605c35dbbaae97)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:13.993238 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:14.210745 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb70c2572c94487c92605c35dbbaae97'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.224380 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb70c2572c94487c92605c35dbbaae97'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.226079 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb70c2572c94487c92605c35dbbaae97'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.312087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb70c2572c94487c92605c35dbbaae97'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.312839 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb70c2572c94487c92605c35dbbaae97'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.332623 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 630/1250] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 23 23:39:13 2022] DELETE /identity/v3/users/cb70c2572c94487c92605c35dbbaae97 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:39:14.610709 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:14.618617 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:14.628496 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a90c3e-0dae-43c3-9a8f-45304a5d3c80 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:14.687627 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:14.688273 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:14.688593 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:14.688914 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] PATH_INFO: `/v3/projects/1ba38a54a00146b18b34af0f4ce24d11` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:14.690168 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba38a54a00146b18b34af0f4ce24d11)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:14.692066 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:14.700748 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:14.822933 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba38a54a00146b18b34af0f4ce24d11', 'request_id': 'req-1ebb64ff-092c-4136-a3c3-06e5f5d24108'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.828759 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba38a54a00146b18b34af0f4ce24d11', 'request_id': 'req-1ebb64ff-092c-4136-a3c3-06e5f5d24108'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.917919 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba38a54a00146b18b34af0f4ce24d11', 'request_id': 'req-1ebb64ff-092c-4136-a3c3-06e5f5d24108'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.934509 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] The token cache is being invalidate because project 1ba38a54a00146b18b34af0f4ce24d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:39:14.935028 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.936069 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:39:14.938693 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 621/1251] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 23 23:39:14 2022] DELETE /identity/v3/projects/1ba38a54a00146b18b34af0f4ce24d11 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:39:24.328423 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:24.928220 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:13.324940 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:13.326397 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:13.387015 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8d61-080c-4ebc-992c-b7897a077be6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:13.436105 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7ee24711494e088ca175321680612f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:13.436758 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:13.437043 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:13.437318 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:13.439081 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:13.502681 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:13.504041 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:13.514347 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 631/1252] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:40:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:40:21.136606 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:21.141715 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:21.152879 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb64ff-092c-4136-a3c3-06e5f5d24108 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:21.157741 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:21.158389 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:21.158670 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:21.158941 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] PATH_INFO: `/v3/users/4f889288a46740f68d536ea51acfd84c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:21.175283 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f889288a46740f68d536ea51acfd84c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:21.177423 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:21.498597 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f889288a46740f68d536ea51acfd84c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:21.511639 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f889288a46740f68d536ea51acfd84c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:21.518862 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f889288a46740f68d536ea51acfd84c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:21.519599 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f889288a46740f68d536ea51acfd84c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:21.520213 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f889288a46740f68d536ea51acfd84c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:21.597805 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 622/1253] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 23 23:40:21 2022] DELETE /identity/v3/users/4f889288a46740f68d536ea51acfd84c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:21.872959 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:21.885087 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389717d2-a6e3-4bdd-b38e-01dd9be480bd service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:21.948751 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:21.949393 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:21.949669 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:21.949949 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] PATH_INFO: `/v3/projects/1196022c84174e3895adeec289dde9bc` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:21.958476 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:21.962039 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1196022c84174e3895adeec289dde9bc)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:21.963969 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:22.078675 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1196022c84174e3895adeec289dde9bc', 'request_id': 'req-034f41ca-e0d0-404c-9062-59ba1408923d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.086073 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1196022c84174e3895adeec289dde9bc', 'request_id': 'req-034f41ca-e0d0-404c-9062-59ba1408923d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.092368 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1196022c84174e3895adeec289dde9bc', 'request_id': 'req-034f41ca-e0d0-404c-9062-59ba1408923d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.162132 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] The token cache is being invalidate because project 1196022c84174e3895adeec289dde9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:40:22.162424 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.163284 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.165389 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 632/1254] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 23 23:40:21 2022] DELETE /identity/v3/projects/1196022c84174e3895adeec289dde9bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:22.169650 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:22.171156 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:22.184962 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09252b-abe4-4f5f-9565-e487dac031be admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:22.247392 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:22.250428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:22.250428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:22.250428 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] PATH_INFO: `/v3/users/ca3b158800314739af35e4c54d73d084` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:22.262926 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3b158800314739af35e4c54d73d084)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:22.264958 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:22.470238 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3b158800314739af35e4c54d73d084'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.474835 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:22.483152 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3b158800314739af35e4c54d73d084'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.490112 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3b158800314739af35e4c54d73d084'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.491483 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3b158800314739af35e4c54d73d084'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.492159 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3b158800314739af35e4c54d73d084'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:22.575442 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 623/1255] 10.222.0.91 () {58 vars in 1224 bytes} [Tue Aug 23 23:40:22 2022] DELETE /identity/v3/users/ca3b158800314739af35e4c54d73d084 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:22.838727 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:22.840182 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:22.856871 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f41ca-e0d0-404c-9062-59ba1408923d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:22.917337 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ea3af316ee47e789d80e3a6d797918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85959ef3f874453fbd26b056e71b4f53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:22.917991 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:22.918261 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:22.918537 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] PATH_INFO: `/v3/projects/207592a65a6043b195cb40e468f8f2ab` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:22.930690 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] RBAC: Authorizing `identity:delete_project(project_id=207592a65a6043b195cb40e468f8f2ab)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:22.932672 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:23.060552 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207592a65a6043b195cb40e468f8f2ab', 'request_id': 'req-870d7222-c073-43c8-b2ed-fb450062876a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:23.067512 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207592a65a6043b195cb40e468f8f2ab', 'request_id': 'req-870d7222-c073-43c8-b2ed-fb450062876a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:23.073850 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207592a65a6043b195cb40e468f8f2ab', 'request_id': 'req-870d7222-c073-43c8-b2ed-fb450062876a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:23.201535 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] The token cache is being invalidate because project 207592a65a6043b195cb40e468f8f2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:40:23.201829 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:23.202520 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-870d7222-c073-43c8-b2ed-fb450062876a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:23.204074 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 633/1256] 10.222.0.91 () {58 vars in 1233 bytes} [Tue Aug 23 23:40:22 2022] DELETE /identity/v3/projects/207592a65a6043b195cb40e468f8f2ab => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:32.648822 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:33.197951 dv-osbrick-853457-3-ceph devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:43:48.690145 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:43:48.691882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:43:48.842283 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fedfc8-a805-4eb5-ad3e-3e9fdee25d06 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:43:48.914444 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b02617b277d4205a247fbae67b78732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a5d81bcdbc149a880b2a9bd41ce67ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:43:48.915068 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:43:48.915351 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:43:48.915882 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:43:48.917666 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:43:48.930060 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:43:48.931696 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf56718-2d2f-4008-8b19-a01fef4debff service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:43:48.942116 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 624/1257] 10.222.0.91 () {60 vars in 1365 bytes} [Tue Aug 23 23:43:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:43:58.937792 dv-osbrick-853457-3-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=84 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}